option (DataStreamReader)

Adds an input option for the underlying data source.

Syntax

option(key, value)

Parameters

Parameter	Type	Description
key	str	The option key.
value	str, int, float, or bool	The option value.

Returns

DataStreamReader

Examples

Python

spark.readStream.option("x", 1)
# <...streaming.readwriter.DataStreamReader object ...>

Generate 10 rows per second using the Rate source:

Python

import time
q = spark.readStream.format(
    "rate").option("rowsPerSecond", 10).load().writeStream.format("console").start()
time.sleep(3)
q.stop()