Skip to main content

Managed file source connectors

Databricks Lakeflow Connect provides fully-managed connectors for ingesting unstructured files from enterprise file storage services. Each connector handles source-specific authentication, incremental reads, and automated retries.

Supported connectors

Connector components

A file source connector has the following components:

Component

Description

Connection

A Unity Catalog securable object that stores authentication details for the file storage service.

Ingestion pipeline

A pipeline that copies files from the source into the destination tables. The ingestion pipeline runs on serverless compute.

Destination tables

The tables where the ingestion pipeline writes the data. These are streaming tables, which are Delta tables with extra support for incremental data processing.