Managed file source connectors
Databricks Lakeflow Connect provides fully-managed connectors for ingesting unstructured files from enterprise file storage services. Each connector handles source-specific authentication, incremental reads, and automated retries.
Supported connectors
-
- Microsoft SharePoint
- Ingest files and list data from Microsoft SharePoint sites.
Connector components
A file source connector has the following components:
Component | Description |
|---|---|
Connection | A Unity Catalog securable object that stores authentication details for the file storage service. |
Ingestion pipeline | A pipeline that copies files from the source into the destination tables. The ingestion pipeline runs on serverless compute. |
Destination tables | The tables where the ingestion pipeline writes the data. These are streaming tables, which are Delta tables with extra support for incremental data processing. |