Connect to Fivetran

Fivetran automated data integration adapts as schemas and APIs change, ensuring reliable data access and simplified analysis with ready-to-query schemas.

You can integrate your Databricks SQL warehouses (formerly Databricks SQL endpoints) and Databricks clusters with Fivetran. The Fivetran integration with Databricks helps you centralize data from disparate data sources into Delta Lake.

Connect to Fivetran using Partner Connect

To connect your Databricks workspace to Fivetran using Partner Connect, see Connect to ingestion partners using Partner Connect.

Note

Partner Connect does not integrate Fivetran with Databricks clusters. To integrate a cluster with Fivetran, connect to Fivetran manually.

For an overview of the Partner Connect procedure, watch this YouTube video (3 minutes).

Connect to Fivetran manually

For an overview of the manual connection procedure, watch this YouTube video (2 minutes).

Note

To connect a SQL warehouse with Fivetran faster, use Partner Connect.

Requirements

Before you connect to Fivetran manually, you must have the following:

Tip

If the Fivetran tile in Partner Connect in your workspace has a check mark icon inside of it, you can get the connection details for the connected SQL warehouse by clicking the tile and then expanding Connection details. The Personal access token is hidden; you must create a replacement personal access token and enter that new token instead when Fivetran asks you for it.

Steps to connect

To connect to Fivetran manually, do the following:

  1. Sign in to your Fivetran account, or create a new Fivetran account, at https://fivetran.com/login.

    Important

    If you sign in to your organization’s Fivetran account, a Choose Destination page may display, listing one or more existing destination entries with the Databricks logo. These entries might contain connection details for compute resources in workspaces that are separate from yours. If you still want to reuse one of these connections, and you trust the compute resource and have access to it, choose that destination and then skip ahead to Next steps. Otherwise, choose any available destination to get past this page, and then go to https://fivetran.com/account.

  2. In your Dashboard page in Fivetran, click the Destinations tab. (If the Dashboard page is not displayed, go to https://fivetran.com/account.)

  3. Click Add Destination.

  4. Enter a Destination name and click Add.

  5. On the Fivetran is modern ELT page, click Set up a connector.

  6. Click a data source, and then click Next.

  7. Follow the on-screen instructions in the Setup Guide in Fivetran to finish setting up the connector.

  8. Click Save & Test.

  9. After the test succeeds, click Continue.

  10. On the Select your data’s destination page, click Databricks on AWS.

  11. Click Continue Setup.

  12. Complete the on-screen instructions in Fivetran to enter the connection details for your existing Databricks compute resource, specifically the Server Hostname and HTTP Path field values, and the token that you generated earlier.

  13. Click Save & Test.

  14. After the test succeeeds, click Continue.

  15. Continue with Next steps.

Next steps

Explore one or more of the following resources on the Fivetran website: