Amazon
Web Services
Microsoft Azure
Google Cloud PlatformSeptember 2024
These features and Databricks platform improvements were released in September 2024.
Note
Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.
September 30, 2024
Git folders and Repos (Legacy) now support 1GB and 20000 workspace assets per working branch.
Meta Llama 3.1 405B Instruct now supported on Databricks Function Calling
September 25, 2024
Meta Llama 3.1 405B Instruct now supported on Databricks Function Calling.
vector_search() now available to all customers (Public Preview)
September 25, 2024
The Public Preview for vector_search() is now available to all customers in regions where Mosaic AI Vector Search is supported. Customers no longer need to request access.
See vector_search function for how to query a Mosaic AI Vector Search index using SQL.
External models now supports instance profiles for Amazon Bedrock
September 30, 2024
External models now supports instance profiles for accessing AWS resources when using models from Amazon Bedrock. See Configure the provider for an endpoint.
Emergency access no longer requires single sign-on
September 25, 2024
To prevent lockouts, account admins can now set up emergency access for up to twenty users, even if single sign-on is not configured. These users can sign into Databricks using multi-factor authentication with FIDO 2 security keys, like YubiKey or a mobile authenticator app. See Emergency access to prevent lockouts.
Meta Llama 3.2 3B and 1B models are supported in Model Serving
September 25, 2024
The Meta Llama 3.2 3B and Meta Llama 3.2 1B models are now supported in Foundation Model APIs provisioned throughput.
Meta Llama 3.2 3B and 1B models are supported in Foundation Model Fine-tuning
September 25, 2024
The Meta Llama 3.2 3B and Meta Llama 3.2 1B models are now supported in Foundation Model Fine-tuning. See Supported models.
Publish to Power BI is now generally available
September 24, 2024
The Publish to Power BI feature is now generally available. This feature allows users to seamlessly create semantic models from tables/schemas on Databricks and publish them directly to Power BI Service.
To get started, see Publish to Power BI Online from Databricks.
Use @ to reference tables in Databricks Assistant prompts
September 24, 2024
To quickly reference tables in Assistant prompts, use the @ symbol. See Reference tables in prompts using @.
Prototype and export tool-calling GenAI Agents in AI Playground
September 24, 2024
Use the AI Playground to prototype, build, and then export tool-calling GenAI agents. You can now give your AI agent tools in the form of Unity Catalog functions and interact with the agent directly in AI Playground.
Export the AI agent to notebooks to iterate further, evaluate quality, and deploy it. See Create an AI agent.
Control external access to data in Unity Catalog using the new EXTERNAL USE SCHEMA privilege
September 18, 2024
The new EXTERNAL USE SCHEMA privilege enables you to restrict access to data in Unity Catalog when external processing engines like Iceberg clients or Microsoft Fabric use Unity Catalog open APIs or Iceberg APIs to access that data. See Enable external data access to Unity Catalog.
GTE v1.5 (English) embedding models are now supported in Foundation Model API provisioned throughput
September 13, 2024
Foundation Model APIs provisioned throughput now supports GTE v1.5 (English) models: gte-base-en-v1.5 and gte-large-en-v1.5.
Databricks Assistant Quick Fix debugs code inline
September 12, 2024
Assistant Quick Fix recommends single-line fixes for running code when it returns an error. Accept the fix and continue to run the code.
See Quick Fix.
AI Gateway is now Public Preview
September 9, 2024
Mosaic AI Gateway is now Public Preview. It is a centralized service that streamlines the usage and management of generative AI models within an organization.
AI Gateway brings governance, monitoring, and production readiness to model serving endpoints using the following features:
Permission and rate limiting to control who has access and how much access.
Payload logging to monitor and audit data being sent to model APIs using inference tables.
Usage tracking to monitor operational usage on endpoints and associated costs using system tables.
AI Guardrails to prevent unwanted data and unsafe data in requests and responses.
Traffic routing to minimize production outages during and after deployment.
Meta Llama 3.1 70B and 8B models supported in Foundation Model Fine-tuning
September 9, 2024
Meta Llama 3.1 70B and Meta Llama 3.1 8B models are now supported in Foundation Model Fine-tuning. See Supported models.
Extended AI-generated comments support
September 6, 2024
AI-generated comments support now includes catalogs, schemas, functions, models, and volumes in addition to tables and table columns. An inline assistant also helps edit comments in Catalog Explorer. See Add AI-generated comments to Unity Catalog objects.
Monitor clean room usage in the billable usage table
September 5, 2024
The system.billing.usage table now includes a usage_metadata.central_clean_room_id value, allowing you to monitor costs incurred by clean room usage. See Billable usage system table reference.
Databricks extension for Visual Studio Code is GA
September 4, 2024
The Databricks extension for Visual Studio Code is now generally available. The extension allows you to connect to your remote Databricks workspaces from Visual Studio Code and then easily define, deploy, and run Databricks Asset Bundles, debug notebooks and run them as jobs, run files on clusters and as jobs, and synchronize local code to your workspace, all from the VSCode IDE.
To install the Databricks extension for Visual Studio Code and quickly get started, see What is the Databricks extension for Visual Studio Code?.
Function calling is now supported on Foundation Model APIs provisioned throughput
September 3, 2024
OpenAI compatible function calling is now available on Foundation Model APIs provisioned throughput. This launch also includes function calling support for the Llama 3.1 8B Instruct model on provisioned throughput workloads.
Foundation Model APIs pay-per-token available in eu-central-1 and eu-west-1
September 3, 2024
Foundation Model APIs pay-per-token is now available in eu-central-1 and eu-west-1. See Model serving feature availability
System tables are now generally available
September 3, 2024
The Databricks system tables platform is now generally available. This launch also includes the GA release of the system.billing.usage and system.billing.list_price tables. See Monitor account activity with system tables.