isnan
An expression that returns true if the column is NaN. Supports Spark Connect.
For the corresponding Databricks SQL function, see isnan function.
Syntax
Python
from pyspark.sql import functions as dbf
dbf.isnan(col=<col>)
Parameters
Parameter | Type | Description |
|---|---|---|
|
| Target column to compute on. |
Returns
pyspark.sql.Column: True if value is NaN and False otherwise.
Examples
Python
from pyspark.sql import functions as dbf
df = spark.createDataFrame([(1.0, float('nan')), (float('nan'), 2.0)], ("a", "b"))
df.select("*", dbf.isnan("a"), dbf.isnan(df.b)).show()
Output
+---+---+--------+--------+
| a| b|isnan(a)|isnan(b)|
+---+---+--------+--------+
|1.0|NaN| false| true|
|NaN|2.0| true| false|
+---+---+--------+--------+