Shopify connector
This feature is in Beta. To use it, a workspace admin must turn on Lakeflow Connect for Shopify from the Previews page. See Manage Databricks previews.
The managed Shopify connector in Lakeflow Connect ingests e-commerce data such as products, orders, customers, inventory, fulfillments, and discounts from Shopify into Databricks.
Feature availability
Feature | Availability |
|---|---|
UI-based pipeline authoring |
|
API-based pipeline authoring |
|
Declarative Automation Bundles |
|
Incremental ingestion |
|
Unity Catalog governance |
|
Orchestration using Databricks Workflows |
|
API-based column selection and deselection |
|
API-based row filtering |
|
SCD Type 2 |
Tables with semi-structured (VARIANT) columns don't support SCD type 2. |
Automated schema evolution: New and deleted columns |
|
Automated schema evolution: Data type changes |
|
Automated schema evolution: Column renames |
Requires a full refresh. |
Authentication methods
Authentication method | Availability |
|---|---|
OAuth U2M |
|
OAuth M2M |
OAuth client credentials from a Shopify app. |
Basic authentication (username/password) |
|
Ingest from Shopify in 3 steps
Before starting, review the Databricks user persona, supported interfaces, ingestion frequency, and common patterns.
Start ingesting from Shopify
- Configure Shopify for ingestion (Admins): Set up Shopify to authenticate with Databricks.
- Create a Unity Catalog connection (Admins): Create a connection in Catalog Explorer so non-admins can create pipelines.
- Create an ingestion pipeline (Admins or non-admins): Select any supported interface and create a pipeline from an existing connection.