October 2024

These features and Databricks platform improvements were released in October 2024.

Note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

Structured outputs supported on Mosaic AI Model Serving (Public Preview)

October 16, 2024

Structured outputs are now supported on Mosaic AI Model Serving as part of Foundation Model APIs. You can now specify a JSON schema to format responses generated from your chat models. See Structured outputs on Databricks.

Attribute serverless usage with budget policies (Public Preview)

October 15, 2024

To assist with serverless billing attribution, workspace admins can now create and assign budget policies to users, groups, or service principals. Budget policies enforce custom tags on all serverless usage incurred by the policy asignee. This allows for granular billing attribution of serverless usage in notebooks, jobs, and pipelines.

For more information, see Attribute serverless usage with budget policies.

Serverless compute automatically enabled on eligible accounts

October 15, 2024

Databricks has started making serverless compute for notebooks, jobs, and Delta Live Tables available by default on eligible accounts, beginning with accounts on the Premium plan or above. See Connect to serverless compute.

The billable usage system table now attributes networking costs

October 11, 2024

The billable usage system table now includes fields to help monitor costs incurred from connecting serverless compute to your resources. See Billable usage system table reference.

Filters on notebook results tables now persist

October 8, 2024

Notebooks results tables now persist filters when you reopen a notebook. See Filter results.

Improvements to comments in notebooks

October 8, 2024

Improvements to the UI for commenting in notebooks make comments easier to add and find. For more information, see Code comments.

Databricks Runtime 16.0 (Beta)

October 8, 2024

Databricks Runtime 16.0 and Databricks Runtime 16.0 ML are now available as Beta releases.

See Databricks Runtime 16.0 (Beta) and Databricks Runtime 16.0 for Machine Learning (Beta).

Mosaic AI Model Serving now supports batch inference

October 8, 2024

Mosaic AI Model Serving now supports performing batch LLM inference using ai_query. See Perform batch inference using ai_query.

Create secure data and AI apps for your users with Databricks Apps (Public Preview)

October 8, 2024

With Databricks Apps, you can use popular Python frameworks to create applications that run in the Databricks platform and use the resources and features of the Databricks platform, including Unity Catalog for governance, Databricks SQL to query data, AI features such as model serving, and the already configured security rules in your workspaces. See What is Databricks Apps?.

Improvements to %autoreload keep Python modules synced with source code

October 8, 2024

Starting with Databricks Runtime 16.0, when you import a Python module from workspace files, Databricks automatically suggests using %autoreload if the module has changed since its last import. See Autoreload for Python modules.

Salesforce ingestion connector simplification

October 7, 2024

The Salesforce ingestion connector now automates source setup, which previously required manual configuration. To follow the simplified Salesforce ingestion process, see Ingest data from Salesforce.

Compliance security profile with serverless compute support

October 3, 2024

The compliance security profile is now supported in more regions and compliance standards with serverless SQL warehouses, serverless compute for notebooks and workflows, and serverless DLT pipelines. See Which compute resources get enhanced security and Compliance security profile compliance standards with serverless compute availability.

Serverless compute is now available in the eu-west-2 region

October 2, 2024

Serverless compute for notebooks, workflows, and Delta Live Tables is now available in the eu-west-2 region. See Connect to serverless compute.