partitioning.hours

A transform for timestamps to partition data into hours.

note

This function can be used only in combination with DataFrameWriterV2.partitionedBy method.

Syntax

Python

from pyspark.sql.functions import partitioning

partitioning.hours(col)

Parameters

Parameter	Type	Description
col	pyspark.sql.Column or str	Target date or timestamp column to work on.

Examples

Python

from pyspark.sql.functions import partitioning
df.writeTo("catalog.db.table").partitionedBy(
    partitioning.hours("ts")
).createOrReplace()