vector_inner_product

Returns the inner product (dot product) between two float vectors. The vectors must have the same dimension.

For the corresponding Databricks SQL function, see vector_inner_product function.

Syntax

Python

from pyspark.sql import functions as dbf

dbf.vector_inner_product(left=<left>, right=<right>)

Parameters

Parameter	Type	Description
left	pyspark.sql.Column or column name	First vector column.
right	pyspark.sql.Column or column name	Second vector column.

Parameter	Type	Description
left	pyspark.sql.Column or column name	First vector column.
right	pyspark.sql.Column or column name	Second vector column.

Returns

pyspark.sql.Column: Inner product as a float value.

Examples

Python

from pyspark.sql import functions as dbf
from pyspark.sql.types import ArrayType, FloatType, StructType, StructField

schema = StructType([StructField('a', ArrayType(FloatType())), StructField('b', ArrayType(FloatType()))])
df = spark.createDataFrame([([1.0, 2.0, 3.0], [4.0, 5.0, 6.0])], schema)
df.select(dbf.vector_inner_product('a', 'b')).first()[0]
# 32.0