range
Create a DataFrame with single LongType column named id, containing elements in a range from start to end (exclusive) with step value step.
Syntax
Python
spark.tvf.range(start, end=None, step=1, numPartitions=None)
Parameters
Parameter | Type | Description |
|---|---|---|
| int | The start value. |
| int, optional | The end value (exclusive). |
| int, optional | The incremental step (default: 1). |
| int, optional | The number of partitions of the DataFrame. |
Examples
Example 1: Generate range with start, end, and step
Python
spark.tvf.range(1, 7, 2).show()
Output
+---+
| id|
+---+
| 1|
| 3|
| 5|
+---+
Example 2: Generate range with only end value
Python
spark.tvf.range(3).show()
Output
+---+
| id|
+---+
| 0|
| 1|
| 2|
+---+