Streaming Data Sources and Sinks

Structured Streaming has built-in support for a number of streaming data sources and sinks (for example, files and Kafka) and programmatic interfaces that allow you to specify arbitrary data writers. These are explored in the topics below.

• Apache Kafka
• Amazon Kinesis
• Faster S3 File Source with SQS
• Azure Event Hubs
• Databricks Delta Tables
• Read and Write Streaming Avro Data to a DataFrame
• Write to Arbitrary Data Sinks