`ai_classify` function

Applies to: check marked yes Databricks SQL Databricks Runtime

Preview

In the preview:

The underlying language model can handle several languages, however these functions are tuned for English.
There is rate limiting for the underlying Foundation Model APIs. See Foundation Model APIs limits to update these limits.
Due to rate limiting, this function is designed for testing on small datasets that have less than 100 rows. For use cases with over 100 rows of data, Databricks recommends using ai_query and a provisioned throughput endpoint. See Perform batch LLM inference using ai_query.

The ai_classify() function allows you to invoke a state-of-the-art generative AI model to classify input text according to labels you provide using SQL. This function uses a chat model serving endpoint made available by Databricks Foundation Model APIs.

Requirements

Important

The underlying models that might be used at this time are licensed under the Apache 2.0 License, Copyright © The Apache Software Foundation or the LLAMA 3.1 Community License Copyright © Meta Platforms, Inc. All rights reserved. Customers are responsible for ensuring compliance with applicable model licenses.

Databricks recommends reviewing these licenses to ensure compliance with any applicable terms. If models emerge in the future that perform better according to Databricks’s internal benchmarks, Databricks might change the model (and the list of applicable licenses provided on this page).

Currently, Meta-Llama-3.1-70B-Instruct is the underlying model that powers these AI functions.

This function is only available on workspaces in AI Functions using Foundation Model APIs supported regions.
This function is not available on Databricks SQL Classic.
Check the Databricks SQL pricing page.

Note

In Databricks Runtime 15.1 and above, this function is supported in Databricks notebooks, including notebooks that are run as a task in a Databricks workflow.

Syntax

ai_classify(content, labels)

Arguments

content: A STRING expression, the text to be classified.
labels: An ARRAY<STRING> literal, the expected output classification labels. Must contain at least 2 elements, and no more than 20 elements.

Returns

A STRING. The value matches one of the strings provided in the labels argument. Returns null if the content cannot be classified.

Examples

> SELECT ai_classify("My password is leaked.", ARRAY("urgent", "not urgent"));
  urgent

> SELECT
    description,
    ai_classify(description, ARRAY('clothing', 'shoes', 'accessories', 'furniture')) AS category
  FROM
    products
  LIMIT 10;

ai_analyze_sentiment function

ai_classify function