partitioning.days
A transform for timestamps and dates to partition data into days.
note
This function can be used only in combination with DataFrameWriterV2.partitionedBy method.
Syntax
Python
from pyspark.sql.functions import partitioning
partitioning.days(col)
Parameters
Parameter | Type | Description |
|---|---|---|
|
| Target date or timestamp column to work on. |
Examples
Python
from pyspark.sql.functions import partitioning
df.writeTo("catalog.db.table").partitionedBy(
partitioning.days("ts")
).createOrReplace()