Connect to a data ingestion partner using Partner Connect

To connect your Databricks workspace to a data ingestion partner solution using Partner Connect, you typically follow the steps in this article.

Important

Before you follow the steps in this article, see the appropriate connection guide in Databricks Partner Connect partners for important partner-specific information. There might be differences in the connection steps between partner solutions. Some partner solutions also allow you to integrate with Databricks SQL warehouses (formerly Databricks SQL endpoints) or Databricks clusters, but not both.

Requirements

See the requirements for using Partner Connect.

Important

For partner-specific requirements, see the appropriate connection guide in Databricks Partner Connect partners.

Steps to connect to a data ingestion partner

To connect your Databricks workspace to a data ingestion partner solution, follow the steps in this section.

Tip

If you have an existing partner account, Databricks recommends that you follow the steps to connect to the partner solution manually in the appropriate connection guide in Databricks Partner Connect partners. This is because the connection experience in Partner Connect is optimized for new partner accounts.

  1. In the sidebar, click Partner Connect button Partner Connect.

  2. Click the partner tile.

    Note

    If the partner tile has a check mark icon inside it, an administrator has already used Partner Connect to connect the partner to your workspace. Skip to step 5. The partner uses the email address for your Databricks account to prompt you to sign in to your existing partner account.

  3. Select a catalog for the partner to write to, then click Next.

    Note

    If a partner doesn’t support Unity Catalog with Partner Connect, the workspace default catalog is used. If your workspace isn’t Unity Catalog-enabled, hive_metastore is used.

    Partner Connect creates the following resources in your workspace:

    • A SQL warehouse named <PARTNER>_ENDPOINT by default. You can change this default name before you click Next.

    • A Databricks service principal named <PARTNER>_USER.

    • A Databricks personal access token that is associated with the <PARTNER>_USER service principal.

    Partner Connect also grants the following privileges to the <PARTNER>_USER service principal:

    • (Unity Catalog) USE CATALOG: Required to interact with objects in the selected catalog.

    • (Unity Catalog) CREATE SCHEMA: Required to interact with objects in the selected schema.

    • (Hive metastore) USAGE: Required to interact with objects in the Hive metastore.

    • (Hive metastore) CREATE: Grants the ability to create objects in the Hive metastore.

  4. Click Next.

    The Email box displays the email address for your Databricks account. The partner uses this email address to prompt you to either create a new partner account or sign in to your existing partner account.

  5. Click Connect to <Partner> or Sign in.

    A new tab opens in your web browser, which displays the partner website.

  6. Complete the on-screen instructions on the partner website to create your trial partner account or sign in to your existing partner account.