October 2024

These features and Databricks platform improvements were released in October 2024.

Note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

The billable usage system table now attributes networking costs

October 11, 2024

The billable usage system table now includes fields to help monitor costs incurred from connecting serverless compute to your resources. See Billable usage system table reference.

Improvements to comments in notebooks

October 8, 2024

Improvements to the UI for commenting in notebooks make comments easier to add and find. For more information, see Code comments.

Databricks Runtime 16.0 (Beta)

October 8, 2024

Databricks Runtime 16.0 and Databricks Runtime 16.0 ML are now available as Beta releases.

See Databricks Runtime 16.0 (Beta) and Databricks Runtime 16.0 for Machine Learning (Beta).

Mosaic AI Model Serving now supports batch inference

October 8, 2024

Mosaic AI Model Serving now supports performing batch LLM inference using ai_query. See Perform batch inference using ai_query.

Create secure data and AI apps for your users with Databricks Apps (Public Preview)

October 8, 2024

With Databricks Apps, you can use popular Python frameworks to create applications that run in the Databricks platform and use the resources and features of the Databricks platform, including Unity Catalog for governance, Databricks SQL to query data, AI features such as model serving, and the already configured security rules in your workspaces. See What is Databricks Apps?.

Improvements to %autoreload keep Python modules synced with source code

October 8, 2024

Starting with DBR version 16.0, when you import a Python module from the Workspace File Store, Databricks automatically suggests using %autoreload if the module has changed since its last import. See Autoreload for Python modules.

Salesforce ingestion connector simplification

October 7, 2024

The Salesforce ingestion connector now automates source setup, which previously required manual configuration. To follow the simplified Salesforce ingestion process, see Ingest data from Salesforce.

Compliance security profile with serverless compute support

October 3, 2024

The compliance security profile is now supported in more regions and compliance standards with serverless SQL warehouses, serverless compute for notebooks and workflows, and serverless DLT pipelines. See Which compute resources get enhanced security and Compliance security profile compliance standards with serverless compute availability.

Serverless compute is now available in the eu-west-2 region

October 2, 2024

Serverless compute for notebooks, workflows, and Delta Live Tables is now available in the eu-west-2 region. See Connect to serverless compute.