Skip to main content

options (DataFrameReader)

Adds input options for the underlying data source.

Syntax

options(**options)

Parameters

Parameter

Type

Description

**options

dict

String keys mapped to primitive-type values.

Returns

DataFrameReader

Examples

Read a CSV file with nullValue and header options set.

Python
import tempfile
with tempfile.TemporaryDirectory(prefix="options") as d:
df = spark.createDataFrame([{"age": 100, "name": "Alice"}])
df.write.option("header", True).mode("overwrite").format("csv").save(d)

spark.read.options(
nullValue="Alice",
header=True
).format('csv').load(d).show()
# +---+----+
# |age|name|
# +---+----+
# |100|NULL|
# +---+----+