Skip to main content

Shopify connector

Beta

This feature is in Beta. To use it, a workspace admin must turn on Lakeflow Connect for Shopify from the Previews page. See Manage Databricks previews.

The managed Shopify connector in Lakeflow Connect ingests e-commerce data such as products, orders, customers, inventory, fulfillments, and discounts from Shopify into Databricks.

Feature availability

Feature

Availability

UI-based pipeline authoring

Green check icon Supported

API-based pipeline authoring

Green check icon Supported

Declarative Automation Bundles

Green check icon Supported

Incremental ingestion

Green check icon Supported

Unity Catalog governance

Green check icon Supported

Orchestration using Databricks Workflows

Green check icon Supported

API-based column selection and deselection

Green check icon Supported

API-based row filtering

Red X icon Not supported

SCD Type 2

Green check icon Supported

Tables with semi-structured (VARIANT) columns don't support SCD type 2.

Automated schema evolution: New and deleted columns

Green check icon Supported

Automated schema evolution: Data type changes

Red X icon Not supported

Automated schema evolution: Column renames

Red X icon Not supported

Requires a full refresh.

Feature

Availability

UI-based pipeline authoring

Green check icon Supported

API-based pipeline authoring

Green check icon Supported

Declarative Automation Bundles

Green check icon Supported

Incremental ingestion

Green check icon Supported

Unity Catalog governance

Green check icon Supported

Orchestration using Databricks Workflows

Green check icon Supported

API-based column selection and deselection

Green check icon Supported

API-based row filtering

Red X icon Not supported

SCD Type 2

Green check icon Supported

Tables with semi-structured (VARIANT) columns don't support SCD type 2.

Automated schema evolution: New and deleted columns

Green check icon Supported

Automated schema evolution: Data type changes

Red X icon Not supported

Automated schema evolution: Column renames

Red X icon Not supported

Requires a full refresh.

Authentication methods

Authentication method

Availability

OAuth U2M

Red X icon Not supported

OAuth M2M

Green check icon Supported

OAuth client credentials from a Shopify app.

Basic authentication (username/password)

Red X icon Not supported

Authentication method

Availability

OAuth U2M

Red X icon Not supported

OAuth M2M

Green check icon Supported

OAuth client credentials from a Shopify app.

Basic authentication (username/password)

Red X icon Not supported

Ingest from Shopify in 3 steps

Start ingesting from Shopify

  1. Configure Shopify for ingestion (Admins): Set up Shopify to authenticate with Databricks.
  2. Create a Unity Catalog connection (Admins): Create a connection in Catalog Explorer so non-admins can create pipelines.
  3. Create an ingestion pipeline (Admins or non-admins): Select any supported interface and create a pipeline from an existing connection.