Overview of SharePoint ingestion setup
Learn about the supported authentication methods for the managed SharePoint connector in Lakeflow Connect. The managed SharePoint connector supports ingestion of unstructured files (such as PDFs and DOCX) as well as structured formats (such as CSV, JSON, and Excel) into Delta tables. For custom pipelines using Spark and SQL APIs with full control over parsing and transformations, see Ingest files from SharePoint.
This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.
Choose your SharePoint connector
Lakeflow Connect offers two SharePoint connectors. They both access data in SharePoint, but differ in their level of management.
Connector | Description |
|---|---|
A fully-managed connector. Simple, low-maintenance connector for enterprise applications that ingests data into Delta tables and keeps them in sync with the source. | |
Standard SharePoint connector | Build custom ingestion pipelines with SQL, PySpark, or Lakeflow Spark Declarative Pipelines using batch and streaming APIs such as |
Databricks recommends the managed SharePoint connector for most use cases.
Which authentication method should I choose?
The managed SharePoint connector supports the following authentication methods:
- OAuth U2M: Databricks-managed (Recommended)
- Databricks manages the OAuth app and token refresh. No Azure app registration required. Recommended for most users.
- OAuth U2M: Custom-managed
- Bring your own Azure app registration. Use when your organization requires control over app ownership or API rate limiting.
- OAuth M2M
- For fully automated production pipelines that run without user interaction.
- OAuth with manual token refresh
- A legacy method. Not recommended for new implementations.
Set up OAuth U2M: Databricks-managed (Recommended)
This method requires no Azure app registration. Databricks manages OAuth configuration and token refresh automatically. For complete setup steps, see Configure OAuth U2M: Databricks-managed for Microsoft SharePoint ingestion.