exists

Returns whether a predicate holds for one or more elements in the array. Supports Spark Connect.

For the corresponding Databricks SQL function, see exists function.

Syntax

Python

from pyspark.sql import functions as dbf

dbf.exists(col=<col>, f=<f>)

Parameters

Parameter	Type	Description
col	pyspark.sql.Column or str	Name of column or expression.
f	function	A function that returns the Boolean expression.

Parameter	Type	Description
col	pyspark.sql.Column or str	Name of column or expression.
f	function	A function that returns the Boolean expression.

Returns

pyspark.sql.Column: True if "any" element of an array evaluates to True when passed as an argument to given function and False otherwise.

Examples

Python

from pyspark.sql import functions as dbf
df = spark.createDataFrame([(1, [1, 2, 3, 4]), (2, [3, -1, 0])],("key", "values"))
df.select(dbf.exists("values", lambda x: x < 0).alias("any_negative")).show()

Output

+------------+
|any_negative|
+------------+
|       false|
|        true|
+------------+