Create a SharePoint connection

Beta

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.

Create a Microsoft SharePoint connection in Catalog Explorer to store authentication credentials for Lakeflow Connect ingestion. Any user with the USE CONNECTION privilege on the connection can then create SharePoint ingestion pipelines without needing direct access to the credentials.

Alternatively, admin users can create a connection and a pipeline at the same time in the data ingestion UI. See Create an ingestion pipeline.

For privilege requirements, see Connect to managed ingestion sources.

The following authentication methods are supported:

• M2M OAuth (recommended)
• U2M OAuth
• OAuth with manual token refresh

In most scenarios, Databricks recommends machine-to-machine (M2M) OAuth. M2M scopes connector permissions to a specific site. However, if you want to scope permissions to whatever the authenticating user can access, choose user-to-machine (U2M) OAuth instead. Both methods offer automated token refresh and heightened security.

Prerequisites

Complete the source setup that matches your chosen authentication method. Use the authentication details you obtain to create the connection.

Create a connection

M2M

1. Complete the M2M source setup. You'll use the authentication details that you obtain to create the connection.

2. In the Databricks workspace, click Catalog > Create > Create a connection.

3. On the Connection basics page of the Set up connection wizard, specify a unique Connection name.

4. In the Connection type drop-down menu, select Microsoft SharePoint.

5. In the Auth type drop-down menu, select OAuth Machine to Machine.

6. (Optional) Add a comment.

7. Click Next.

8. On the Authentication page, enter the following credentials for your Microsoft Entra ID app:

   • Client secret: The client secret that you retrieved in the source setup.
   • Client ID: The client ID that you retrieved in the source setup.
   • Domain: The SharePoint instance URL in the following format: https://MYINSTANCE.sharepoint.com
   • Tenant ID: The tenant ID that you retrieved in the source setup.

9. Click Sign in with Microsoft SharePoint.

   A new window opens. After you sign in with your SharePoint credentials, the permissions you're granting to the Entra ID app are shown.

10. Click Accept.

    A Successfully authorized message displays, and you're redirected to the Databricks workspace.

11. Click Create connection.

U2M

1. Complete the U2M source setup. You'll use the authentication details that you obtain to create the connection.

2. In the Databricks workspace, click Catalog > Create > Create a connection.

3. On the Connection basics page of the Set up connection wizard, specify a unique Connection name.

4. In the Connection type drop-down menu, select Microsoft SharePoint.

5. In the Auth type drop-down menu, select OAuth.

6. (Optional) Add a comment.

7. Click Next.

8. On the Authentication page, enter the following credentials for your Microsoft Entra ID app:

   • Client secret: The client secret that you retrieved in the source setup.
   • Client ID: The client ID that you retrieved in the source setup.
   • Domain: The SharePoint instance URL in the following format: https://MYINSTANCE.sharepoint.com
   • Tenant ID: The tenant ID that you retrieved in the source setup.

   

9. Click Sign in with Microsoft SharePoint.

   A new window opens. After you sign in with your SharePoint credentials, the permissions you're granting to the Entra ID app are shown.

10. Click Accept.

    A Successfully authorized message displays, and you're redirected to the Databricks workspace.

11. Click Create connection.

Manual refresh token

1. Complete the manual token refresh source setup. You'll use the authentication details that you obtain to create the connection.

2. In the Databricks workspace, click Catalog > Create > Create a connection.

3. On the Connection basics page of the Set up connection wizard, specify a unique Connection name.

4. In the Connection type drop-down menu, select Microsoft SharePoint.

5. In the Auth type drop-down menu, select OAuth Refresh Token.

6. (Optional) Add a comment.

7. Click Next.

8. On the Authentication page, enter the following credentials for your Microsoft Entra ID app:

   • Tenant ID: The tenant ID that you retrieved in the source setup.
   • Client ID: The client ID that you retrieved in the source setup.
   • Client secret: The client secret that you retrieved in the source setup.
   • Refresh token: The refresh token that you retrieved in the source setup.

   

9. Click Create connection.

Next steps

Create an ingestion pipeline.