format (DataFrameReader)
Specifies the input data source format.
Syntax
format(source)
Parameters
Parameter | Type | Description |
|---|---|---|
| str | The name of the data source, for example |
Returns
DataFrameReader
Examples
Write a DataFrame into a JSON file and read it back.
Python
import tempfile
with tempfile.TemporaryDirectory(prefix="format") as d:
spark.createDataFrame(
[{"age": 100, "name": "Alice"}]
).write.mode("overwrite").format("json").save(d)
spark.read.format('json').load(d).show()
# +---+------------+
# |age| name|
# +---+------------+
# |100|Alice|
# +---+------------+