changes (DataStreamReader)
Returns the row-level changes (Change Data Capture) from the specified table as a streaming DataFrame. Currently only supported for Data Source V2 tables whose catalog implements TableCatalog.loadChangelog(). Use option() to specify the starting version or timestamp and processing options.
Syntax
changes(tableName)
Parameters
Parameter | Type | Description |
|---|---|---|
| str | Name of the table. |
Returns
DataFrame
Examples
Python
spark.readStream.option("startingVersion", "10").changes("my_table")