Hightouch syncs your data in Databricks to the tools that your business teams rely on.
You can integrate your Databricks SQL warehouses (formerly Databricks SQL endpoints) and Databricks clusters with Hightouch.
To connect your Databricks workspace to Hightouch using Partner Connect, see Connect to reverse ETL partners using Partner Connect.
Partner Connect only supports SQL warehouses for Hightouch. To connect a cluster to Hightouch, connect to Hightouch manually.
This section describes how to connect an existing SQL warehouse or cluster in your Databricks workspace to Hightouch manually.
For Databricks SQL warehouses, you can connect to Hightouch using Partner Connect to simplify the experience.
Before you connect to Hightouch manually, you need the following:
A cluster or SQL warehouse in your Databricks workspace.
The connection details for your cluster or SQL warehouse, specifically the Server Hostname, Port, and HTTP Path values.
A Databricks personal access token.. To create a personal access token, do the following:
In your Databricks workspace, click your Databricks username in the top bar, and then select User Settings from the drop down.
Next to Access tokens, click Manage.
Click Generate new token.
(Optional) Enter a comment that helps you to identify this token in the future, and change the token’s default lifetime of 90 days. To create a token with no lifetime (not recommended), leave the Lifetime (days) box empty (blank).
Copy the displayed token to a secure location, and then click Done.
Be sure to save the copied token in a secure location. Do not share your copied token with others. If you lose the copied token, you cannot regenerate that exact same token. Instead, you must repeat this procedure to create a new token. If you lose the copied token, or you believe that the token has been compromised, Databricks strongly recommends that you immediately delete that token from your workspace by clicking the trash can (Revoke) icon next to the token on the Access tokens page.
If you are not able to create or use tokens in your workspace, this might be because your workspace administrator has disabled tokens or has not given you permission to create or use tokens. See your workspace administrator or the following:
As a security best practice when you authenticate with automated tools, systems, scripts, and apps, Databricks recommends that you use OAuth tokens.
If you use personal access token authentication, Databricks recommends using personal access tokens belonging to service principals instead of workspace users. To create tokens for service principals, see Manage tokens for a service principal.
To connect to Hightouch manually, do the following:
Create a workspace by clicking Create a workspace, or select an existing workspace.
If you chose to create a workspace, enter a name for the workspace, and then click Create workspace.
In the workspace navigation pane, click Sources.
Click Add source.
Click Databricks, and then click Continue.
For Server Hostname, enter the Server Hostname value from the requirements.
For Port, enter the Port value from the requirements.
For HTTP Path, enter the HTTP Path value from the requirements.
For Access Token, enter the token value from the requirements.
For Default Schema, enter the name of the target database within the workspace.
Click Test Connection.
After the connection attempt succeeds, click Continue.
Enter a name for the connection, and then click Finish.
Create a destination, a model, and a sync. See Create your first sync in the Hightouch documentation.