Configure Salesforce for ingestion
Preview
LakeFlow Connect is in gated Public Preview. To participate in the preview, contact your Databricks account team.
This article describes how to configure Salesforce for ingestion. This is a prerequisite for ingesting data from Salesforce and loading it into Databricks using LakeFlow Connect.
Salesforce setup
In this step, you’ll create a new connected app and retrieve your authorization information.
If you already have a connected app in your Salesforce account, you can use that. However, be sure to validate that it’s configured per the requirements in the next section.
Create and configure a connected app in Salesforce
In the left-hand pane, click Apps > App Manager > New Connected App.
On the New Connected App page, do the following:
For Basic Information, fill in the fields Connected App Name, API Name, and Contact Email.
Under API (Enable OAuth Settings), click Enable OAuth Settings.
In the Callback URL field, enter
https://<databricks-workspace-url>/login/oauth/salesforce.html
.For example,
https://myorganization.cloud.databricks.com/login/oauth/salesforce.html
In the Selected OAuth Scopes field, add the following scopes:
Manage user data via APIs (api)
Perform requests at any time (refresh_token, offline_access)
Confirm that Require Proof Key for Code Exchange (PKCE) is selected.
Confirm that Require Secret for Web Server Flow and Require Secret for Refresh Token Flow are selected.
Click Save.
On the review page, click Manage.
On the app page, click Edit Policies.
For OAuth Policies, set Permitted Users to
All users may self-authorize
.Note
If your security policy is set to
Only Admin-Approved Users can authorize
, contact your Salesforce admin about adding your profile to the connected app.Ensure that the refresh token does not immediately expire.
Click Save.