April 2024

These features and Databricks platform improvements were released in April 2024.

Note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

Bind storage credentials and external locations to specific workspaces (Public Preview)

April 29, 2024

You can now bind storage credentials and external locations to specific workspaces, preventing access to those objects from other workspaces. This feature is especially helpful if you use workspaces to isolate user data access, for example if you have separate production and development workspaces or a dedicated workspace for handling sensitive data.

For more information, see (Optional) Assign an external location to specific workspaces and (Optional) Assign a storage credential to specific workspaces.

Data lineage now captures reads on tables with column masks and row-level security

April 25, 2024

Data lineage now captures reads on tables that include column masks and row-level security. See Filter sensitive table data using row filters and column masks and Capture and view data lineage using Unity Catalog.

Meta Llama 3 is supported in Model Serving for AWS

April 24, 2024

Databricks Model Serving now supports Meta Llama 3, a dense model architecture built and trained by Meta. The Meta-Llama-3-70-Instruct model is available as part of Foundation Model APIs in pay-per-token serving endpoint regions. See Use Foundation Model APIs.

New columns added to the billable usage system table (Public Preview)

April 24, 2024

The billable usage system table (system.billing.usage) now includes new columns that help you identify the specific product and features associated with the usage. See Billable usage system table reference.

Get serving endpoint schemas (Public Preview)

April 22, 2024

You can now get the serving endpoint schema for your model serving or feature serving endpoints. This capability is available in Public Preview. See Get a model serving endpoint schema.

Jobs created through the UI are now queued by default

April 18, 2024

Queueing of job runs is now automatically enabled when a job is created in the Databricks Jobs UI. When queueing is enabled, and a concurrency limit is reached, job runs are placed in a queue until capacity is available. See What if my job cannot run because of concurrency limits?.

Configuring access to resources from serving endpoints is GA

April 17, 2024

You can now configure environment variables to access resources outside of your feature serving and model serving endpoints. This capability is generally available. See Configure access to resources from model serving endpoints.

Serverless compute for workflows is in public preview

April 16, 2024

Serverless compute for workflows allows you to run your Databricks job without configuring and deploying infrastructure. With serverless compute for workflows, Databricks efficiently manages the compute resources that run your job, including optimizing and scaling compute for your workloads. See Run your Databricks job with serverless compute for workflows.

Lakehouse Federation supports foreign tables with case-sensitive identifiers

April 15, 2024

Lakehouse Federation is now able to federate foreign tables with case-sensitive identifiers for MySQL, SQL Server, BigQuery, Snowflake, and Postgres connections. See What is Lakehouse Federation.

Compute cloning now clones any libraries installed on the original compute

April 11, 2024

When cloning compute, any libraries installed on the original compute will also be cloned. For cases where this behavior is unwanted, there is an alternative Create without libraries button on the compute clone page. See Clone a compute.

Route optimization is available for serving endpoints

April 10, 2024

You can now create route optimized serving endpoints for your model serving or feature serving workflows. See Configure route optimization on serving endpoints.

Delta Live Tables notebook developer experience improvements (Public Preview)

April 3, 2024

Databricks has released a set of Public Preview features in Databricks notebooks that assist in the development and debugging of Delta Live Tables code. See Notebook experience for Delta Live Tables development.

Databricks on AWS GovCloud (Public Preview)

April 1, 2024

AWS GovCloud gives United States government customers and their partners the flexibility to architect secure cloud solutions that comply with the FedRAMP High baseline and other compliance regimes. Databricks on AWS GovCloud provides the Databricks platform deployed in AWS GovCloud with compliance and security controls. See Databricks on AWS GovCloud.