Skip to main content

Microsoft Entra ID connector

Beta

This feature is in Beta. To use it, a workspace admin must turn on Lakeflow Connect for Microsoft Entra ID from the Previews page. See Manage Databricks previews.

The managed Microsoft Entra ID connector in Lakeflow Connect ingests directory objects, role assignments, identity configuration, and audit and sign-in logs from Microsoft Entra ID into Databricks.

Feature availability​

Feature

Availability

UI-based pipeline authoring

Green check icon Supported

API-based pipeline authoring

Green check icon Supported

Declarative Automation Bundles

Green check icon Supported

Incremental ingestion

Green check icon Supported

Unity Catalog governance

Green check icon Supported

Orchestration using Databricks Workflows

Green check icon Supported

API-based column selection and deselection

Green check icon Supported

API-based row filtering

Red X icon Not supported

SCD Type 2

Green check icon Supported

Tables with VARIANT columns (users, serviceprincipals) do not support SCD type 2.

Automated schema evolution: New and deleted columns

Green check icon Supported

Automated schema evolution: Data type changes

Red X icon Not supported

Automated schema evolution: Column renames

Red X icon Not supported

Requires a full refresh.

Feature

Availability

UI-based pipeline authoring

Green check icon Supported

API-based pipeline authoring

Green check icon Supported

Declarative Automation Bundles

Green check icon Supported

Incremental ingestion

Green check icon Supported

Unity Catalog governance

Green check icon Supported

Orchestration using Databricks Workflows

Green check icon Supported

API-based column selection and deselection

Green check icon Supported

API-based row filtering

Red X icon Not supported

SCD Type 2

Green check icon Supported

Tables with VARIANT columns (users, serviceprincipals) do not support SCD type 2.

Automated schema evolution: New and deleted columns

Green check icon Supported

Automated schema evolution: Data type changes

Red X icon Not supported

Automated schema evolution: Column renames

Red X icon Not supported

Requires a full refresh.

Authentication methods​

Authentication method

Availability

OAuth U2M

Red X icon Not supported

OAuth M2M

Green check icon Supported

Application (client) ID and client secret from a Microsoft Entra ID app registration.

Basic authentication (username/password)

Red X icon Not supported

Authentication method

Availability

OAuth U2M

Red X icon Not supported

OAuth M2M

Green check icon Supported

Application (client) ID and client secret from a Microsoft Entra ID app registration.

Basic authentication (username/password)

Red X icon Not supported

Ingest from Microsoft Entra ID in 3 steps​

  1. Configure Microsoft Entra ID for ingestion (Admins): Set up Microsoft Entra ID to authenticate with Databricks.
  2. Create a Unity Catalog connection (Admins): Create a connection in Catalog Explorer to store credentials for Databricks to authenticate with Microsoft Entra ID.
  3. Create an ingestion pipeline (Admins or non-admins): Select any supported interface and create a pipeline from an existing connection.