Create a cluster

There are two types of clusters:

  • All-Purpose clusters can be shared by multiple users. These are typically used to run notebooks. All-Purpose clusters remain active until you terminate them.
  • Job clusters run a job. You create a job cluster when you create a job. Such clusters are terminated automatically after the job is completed.

This article describes how to create an all-purpose cluster. To learn how to create job clusters, see Create a job.

You can also create a cluster using the Clusters API.

Note

You must have permission to create a cluster. See Configure cluster creation permission.

Use the Create button

The easiest way to create a new cluster is to use the Create button:

  1. Click Create Icon Create in the sidebar and select Cluster from the menu. The Create Cluster page appears.

  2. Name and configure the cluster.

    There are many cluster configuration options, which are described in detail in cluster configuration.

    Cluster configuration
  3. Click the Create Cluster button.

    The cluster Configuration tab displays a spinning progress indicator while the cluster is in a pending state.

    Cluster status pending

    When the cluster has started and is ready to use, the progress spinner turns into a solid green circle:

    Cluster status

    This indicates that cluster is in the running state, and you can now attach notebooks and start running commands and queries.

Use the cluster UI

  1. Click compute icon Compute in the sidebar.

  2. Click the Create Cluster button.

    Create cluster
  3. Follow steps 2 and 3 in Use the Create button.