AI Functions on Databricks
Preview
This feature is in Public Preview.
This article describes Databricks AI Functions, built-in SQL functions that allow you to access and serve Large Language Models (LLMs) directly from SQL.
Requirements
These functions are only available on Databricks SQL Pro and Serverless.
These features are in public preview. To enroll in the public preview, please submit the AI Functions Public Preview enrollment form.
ai_generate_text
The ai_generate_text()
function calls an LLM selected by the user with the given prompt and returns the text generated by the model. Returns text generated by a selected large language model (LLM) given the prompt. Users can set additional parameters to control the behavior. Currently Databricks supports calling ChatGPT from OpenAI and Azure OpenAI Service.
ai_query
The ai_query()
function allows you to serve your large language models using Databricks Model Serving and query them. To do so, this function invokes an existing Databricks Model Serving endpoint and parses and returns its response.