recentProgress (StreamingQuery)

Returns an array of the most recent StreamingQueryProgress updates for this query. The number of progress updates retained is configured by spark.sql.streaming.numRecentProgressUpdates.

Returns

list of StreamingQueryProgress

Examples

Python

sdf = spark.readStream.format("rate").load()
sq = sdf.writeStream.format('memory').queryName('this_query').start()
sq.recentProgress
# [...]
sq.stop()