Managed streaming connectors

Databricks Lakeflow Connect provides fully-managed streaming connectors for continuously ingesting data from message buses and event streaming sources into streaming tables. Each connector handles source-specific authentication, message decoding, and pipeline lifecycle management through a declarative configuration, so you don't need to write Structured Streaming code directly.

Supported connectors

• • RabbitMQ
  • Stream messages from RabbitMQ classic queues into streaming tables.

Connector components

A streaming connector has the following components:

Component	Description
Connection	A Unity Catalog securable object that stores the source endpoint and authentication credentials for your streaming source. The managed connector uses this connection to authenticate without requiring credentials in your pipeline configuration.
Ingestion pipeline	A pipeline that continuously reads messages from the streaming source and writes the results to streaming tables. The pipeline runs on serverless compute.
Destination tables	The streaming tables where the ingestion pipeline writes the data.