Walkthrough: Connect to Fivetran using Partner Connect

In this walkthrough, you use Partner Connect to connect a Databricks SQL warehouse in your workspace to Fivetran and then use Fivetran to ingest sample data from Google Sheets into your workspace.

  1. Make sure your Databricks account, workspace, and the signed-in user all meet the requirements for Partner Connect.

  2. In the sidebar, click Partner Connect button Partner Connect.

  3. Click the Fivetran tile.

    Note

    If the Fivetran tile has a check mark icon inside of it, this means one of your administrators has already used Partner Connect to connect Fivetran to your workspace. Contact that admin, who can add you to the Fivetran account that they created by using Partner Connect. After they add you, click the Fivetran tile.

  4. If the Connect to partner dialog displays a Next button, click it.

  5. For Email, enter the email address that you want Fivetran to use to create a 14-day trial Fivetran account for you, or enter the email address for your existing Fivetran account.

  6. Click the button with the label Connect to Fivetran or Sign in.

    Important

    If an error displays stating that someone from your organization has already created an account with Fivetran, contact one of your organization’s administrators and have them add you to your organization’s Fivetran account. After they add you, click Connect to Fivetran or Sign in again.

  7. A new tab opens in your web browser, which displays the Fivetran website.

  8. Complete the on-screen instructions in Fivetran to create your 14-day trial Fivetran account, or to sign in to your existing Fivetran account.

  9. Do one of the following:

Use a new 14-day trial Fivetran account

  1. On the Fivetran is modern ELT page, click Set up a connector.

  2. On the Select your data source page, click Google Sheets, and then click Continue Setup.

  3. Follow the on-screen instructions in the Setup Guide in Fivetran to finish setting up the connector.

  4. Click Save & Test.

  5. After the test succeeds, click Continue.

  6. Do one of the following:

Use an existing Fivetran account

To complete this series of steps, you get the connection details for an existing SQL warehouse in your workspace and then add those details to your Fivetran account.

You must also generate a Databricks personal access token.

Tip

If the Fivetran tile in Partner Connect has a check mark icon inside of it, you can get the connection details for the connected SQL warehouse by clicking the tile and then expanding Connection details. Note however that the Personal access token here is hidden; you must create a replacement personal access token and enter that new token instead when Fivetran asks you for it.

  1. In your Dashboard page in Fivetran, click the Destinations tab.

    Important

    If you sign in to your organization’s Fivetran account, a Choose Destination page may display, listing one or more existing destination entries with the Databricks logo. These entries might contain connection details for SQL warehouses in workspaces that are separate from yours. If you still want to reuse one of these connections, and you trust the SQL warehouse and have access to it, choose that destination, click Add Connector, and then skip ahead to step 5. Otherwise, choose any available destination to get past this page.

  2. Click Add Destination.

  3. Enter a Destination name and click Add.

  4. On the Fivetran is modern ELT page, click Set up a connector.

  5. Click Google Sheets, and then click Next.

  6. Follow the on-screen instructions in the Setup Guide in Fivetran to finish setting up the connector.

  7. Click Save & Test.

  8. After the test succeeds, click Continue.

  9. On the Select your data’s destination page, click Databricks on AWS.

  10. Click Continue Setup.

  11. Complete the on-screen instructions in Fivetran to enter the connection details for your SQL warehouse and your personal access token.

    Note

    By default, the name of the SQL warehouse is FIVETRAN_ENDPOINT.

  12. Click Save & Test.

  13. After the test succeeds, click Continue.

  14. Continue to ingest sample data.

Ingest sample data

  1. Click Start Initial Sync.

  2. View the sample data in your workspace: after the sync succeeds, go to your Databricks workspace.

  3. In Databricks SQL, click Queries.

  4. Click Create Query.

  5. Choose the name of the SQL warehouse.

  6. Enter a query, for example SELECT * FROM google_sheets.my_sheet.

    Note

    Your database and table name here are different. For the correct database and table name, see the details for the connector in Fivetran that you just created.

  7. Click Run. The ingested data displays.

Clean up

After you complete this walkthrough, you should clean up any related resources that you no longer plan to use.

Delete the table

  1. In Databricks SQL, click Queries on the sidebar.

  2. Click Create Query.

  3. Choose the name of the related SQL warehouse.

  4. Enter a query, for example DROP TABLE google_sheets.my_sheet.

    Note

    Your database and table name here are different. For the correct database and table name, see the details for the related connector in Fivetran.

    This query only deletes the table. It does not delete your Google Sheet. You can manually delete your Google Sheet if you no longer plan to use it.

  5. Click Run.

Delete the SQL warehouse

Do one of the following:

  • If you used Partner Connect to create the SQL warehouse:

    1. In Partner Connect, click the Fivetran tile with the check mark icon inside of it.

    2. Click Delete connection.

    3. Click Delete. The SQL warehouse and the related Databricks service principal are deleted.

  • If you used Databricks SQL to create the SQL warehouse:

    1. In Databricks SQL, click SQL Warehouses in the sidebar.

    2. Next to the warehouse, for Actions, click the ellipsis button.

    3. Click Delete.

    4. Confirm the deletion by clicking Delete.

Delete the connection details

  1. In your Dashboard page in Fivetran, click the Destinations tab. (If the Dashboard page is not displayed, go to https://fivetran.com/login.)

  2. Next to the related destination entry with the Databricks logo, click the X icon.

  3. Click Remove Destination.

Additional resources

Fivetran website