September 2024

These features and Databricks platform improvements were released in September 2024.

Note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

AI Gateway is now Public Preview

September 9, 2024

Mosaic AI Gateway is now Public Preview. It is a centralized service that streamlines the usage and management of generative AI models within an organization.

AI Gateway brings governance, monitoring, and production readiness to model serving endpoints using the following features:

Permission and rate limiting to control who has access and how much access.
Payload logging to monitor and audit data being sent to model APIs using inference tables.
Usage tracking to monitor operational usage on endpoints and associated costs using system tables.
AI Guardrails to prevent unwanted data and unsafe data in requests and responses.
Traffic routing to minimize production outages during and after deployment.

Meta Llama 3.1 70B and 8B models supported in Mosaic AI Model Training

September 9, 2024

Meta Llama 3.1 70B and Meta Llama 3.1 8B models are now supported in Mosaic AI Model Training. See Supported models.

Extended AI-generated comments support

September 6, 2024

AI-generated comments support now includes catalogs, schemas, functions, models, and volumes in addition to tables and table columns. An inline assistant also helps edit comments in Catalog Explorer. See Add AI-generated comments to Unity Catalog objects.

Monitor clean room usage in the billable usage table

September 5, 2024

The system.billing.usage table now includes a usage_metadata.central_clean_room_id value, allowing you to monitor costs incurred by clean room usage. See Billable usage system table reference.

Databricks extension for Visual Studio Code is GA

September 4, 2024

The Databricks extension for Visual Studio Code is now generally available. The extension allows you to connect to your remote Databricks workspaces from Visual Studio Code and then easily define, deploy, and run Databricks Asset Bundles, debug notebooks and run them as jobs, run files on clusters and as jobs, and synchronize local code to your workspace, all from the VSCode IDE.

To install the Databricks extension for Visual Studio Code and quickly get started, see What is the Databricks extension for Visual Studio Code?.

Foundation Model APIs pay-per-token available in `eu-central-1` and `eu-west-1`

September 3, 2024

Foundation Model APIs pay-per-token is now available in eu-central-1 and eu-west-1. See Model serving feature availability

System tables are now generally available