InputPartition
A base class representing an input partition returned by the partitions() method of DataSourceReader.
Added in Databricks Runtime 14.3 LTS
Syntax
Python
InputPartition(value)
Parameters
Parameter | Type | Description |
|---|---|---|
| any | The value identifying this partition. |
Notes
This class must be picklable.
Examples
Use the default input partition implementation:
Python
def partitions(self):
return [InputPartition(1)]
Subclass the input partition class:
Python
from dataclasses import dataclass
@dataclass
class RangeInputPartition(InputPartition):
start: int
end: int
def partitions(self):
return [RangeInputPartition(1, 3), RangeInputPartition(4, 6)]