Skip to main content
Last updated on

input_file_block_length

Returns the length of the block being read, or -1 if not available.

Syntax​

Python
from pyspark.sql import functions as sf

sf.input_file_block_length()

Examples​

Example 1: Get input file block length

Python
from pyspark.sql import functions as sf
df = spark.read.text("python/test_support/sql/ages_newlines.csv", lineSep=",")
df.select(sf.input_file_block_length()).show()
Output
+-------------------------+
|input_file_block_length()|
+-------------------------+
|                       87|
|                       87|
|                       87|
|                       87|
|                       87|
|                       87|
|                       87|
|                       87|
+-------------------------+