Structured Streaming Examples

Amazon CloudTrail ETL

The following notebooks explain how you can easily transform your Amazon CloudTrail logs into Parquet from JSON for efficient ad-hoc querying. Check out this blog post for more details.

ETL of Amazon CloudTrail Logs using Structured Streaming in Python

ETL of Amazon CloudTrail Logs using Structured Streaming in Scala

Election Tweets

This notebook will show you how to analyze tweets using Structured Streaming.

You can see the full video here.