Skip to main content

format (DataFrameReader)

Specifies the input data source format.

Syntax​

format(source)

Parameters​

Parameter

Type

Description

source

str

The name of the data source, for example 'json' or 'parquet'.

Parameter

Type

Description

source

str

The name of the data source, for example 'json' or 'parquet'.

Returns​

DataFrameReader

Examples​

Write a DataFrame into a JSON file and read it back.

Python
import tempfile
with tempfile.TemporaryDirectory(prefix="format") as d:
spark.createDataFrame(
[{"age": 100, "name": "Alice"}]
).write.mode("overwrite").format("json").save(d)

spark.read.format('json').load(d).show()
# +---+------------+
# |age| name|
# +---+------------+
# |100|Alice|
# +---+------------+