Skip to main content
RSS Feed

August 2025

These features and Databricks platform improvements were released in August 2025.

note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

OLTP Database tab renamed to Lakebase Postgres in Compute section​

August 29, 2025

The OLTP Database tab in the Compute section of the workspace is renamed to Lakebase Postgres. Use this tab to create and manage your Lakebase database instances.

See Create and manage a database instance.

Account SCIM 2.0 updates​

August 29, 2025

To enhance stability and support future growth, Databricks has updated the Account SCIM API for identity management as follows:

  • Calling GET with filter params filter=displayName eq value_without_quotes results in a syntax error. To prevent this error, use quotation marks to wrap the value (for example, filter=displayName eq "value_with_quotes").

  • Calling GET /api/2.0/accounts/{account_id}/scim/v2/Groups no longer returns members. Instead, iterate through get group details to get membership information. See get group details.

  • Calling PATCH /api/2.0/accounts/{account_id}/scim/v2/Groups/{id} returns a 204 response instead of a 200 response.

These changes apply to new accounts and will be grandfathered into existing accounts. Current integrations will continue to work without disruption.

Track and navigate notebook runs with the new cell execution minimap​

August 28, 2025

Use the cell execution minimap to track your notebook’s progress at a glance. The minimap appears in the right margin and shows each cell’s execution state (skipped, queued, running, success, or error). Hover to see cell details, or click to jump directly to a cell.

For information about using the cell execution minimap, see Navigate the Databricks notebook and file editor.

Admins can now manage a workspace's serverless base environments (Public Preview)​

August 28, 2025

Base environments are custom environment specifications for serverless notebooks that define a serverless environment version and a set of dependencies.

Workspace admins can now create and manage the base environments available in their workspace. They can also set a default base environment for all new serverless notebooks. This allows workspace users to quickly start working in a consistent, cached environment.

See Manage serverless base environments.

Lakebase synced tables supports syncing Apache Iceberg and foreign tables in Snapshot mode​

August 28, 2025

You can now create synced tables in Snapshot sync mode from Iceberg tables or foreign tables.

See Supported source tables.

External MCP servers are in Beta​

August 28, 2025

Users can now connect Databricks to external Model Context Protocol (MCP) servers. This allows agents to access tools outside of Databricks.

See Model Context Protocol (MCP) on Databricks.

Migrate Lakeflow Declarative Pipelines from legacy publishing mode is now GA​

August 28, 2025

Lakeflow Declarative Pipelines has a legacy publishing mode that only allowed publishing to a single catalog and schema. The default publishing mode enables publishing to multiple catalogs and schemas. Migration from the legacy publishing mode to the default publishing mode is now generally available.

See Enable the default publishing mode in a pipeline

Governed tags are Public Preview​

August 26, 2025

You can now create governed tags to enforce consistent tagging across data assets such as catalogs, schemas, and tables. Using governed tags, admins define the allowed keys and values and control which users and groups can assign them to objects. This helps standardize metadata for data classification, cost tracking, access control, and automation.

See Governed tags.

Databricks Runtime 17.2 and Databricks Runtime 17.2 ML are in Beta​

August 26, 2025

Databricks Runtime 17.2 and Databricks Runtime 17.2 ML are now in Beta. These releases include SQL and API enhancements, new migration options, and reliability and performance improvements across the platform.

See Databricks Runtime 17.2 and Databricks Runtime 17.2 for Machine Learning.

Selectively and atomically replace data with INSERT REPLACE USING and INSERT REPLACE ON (GA)​

August 26, 2025

INSERT REPLACE USING and INSERT REPLACE ON are now generally available for Databricks Runtime 17.2. Both SQL commands replace part of the table with the result of a query.

INSERT REPLACE USING replaces rows when the USING columns compare equal under equality. INSERT REPLACE ON replaces rows when they match a user-defined condition.

See INSERT in the SQL language reference and Selectively overwrite data with Delta Lake.

OAuth token federation is now GA​

August 26, 2025

OAuth token federation is now generally available. Token federation enables you to securely access Databricks APIs using tokens from your identity provider (IdP). You can configure token federation policies directly in the Databricks UI, or using the Databricks CLI or REST API.

See Configure a federation policy.

Microsoft SQL Server connector GA​

August 26, 2025

The Microsoft SQL Server ingestion connector in Lakeflow Connect is now generally available. See Configure Microsoft SQL Server for ingestion into Databricks.

New table property to control Delta table compression​

August 26, 2025

You can now explicitly set the compression codec for a Delta table using the delta.parquet.compression.codec table property. This property ensures that all future writes to the table use the chosen codec. See Delta table properties reference.

Data type mapping update for Lakebase synced tables​

August 25, 2025

For newly created synced tables, TIMESTAMP types in source tables are now mapped to TIMESTAMP WITH TIMEZONE in synced tables. In existing synced tables, TIMESTAMP types continue to map to TIMESTAMP WITHOUT TIMEZONE.

See Data type mapping.

Automatic liquid clustering is now available for Lakeflow Declarative Pipelines​

August 25, 2025

You can now use automatic liquid clustering with Lakeflow Declarative Pipelines. Use automatic liquid clustering with CLUSTER BY AUTO, and Databricks intelligently chooses clustering keys to optimize query performance.

See Automatic liquid clustering, create_streaming_table, table, CREATE MATERIALIZED VIEW (Lakeflow Declarative Pipelines), and CREATE STREAMING TABLE (Lakeflow Declarative Pipelines).

Budget policy support for Lakebase database instances and synced tables (Public Preview)​

August 25, 2025

You can now tag a database instance and a synced table with a budget policy to attribute billing usage to specific policies. Additionally, custom tags can be added to a database instance for more granular attribution of compute usage to teams, projects, or cost centers.

See Update a serverless budget policy of a database instance, Create a synced table, and Custom tags.

Expanded region availability for Databricks Apps​

August 25, 2025

Databricks Apps now available in the following regions:

  • ap-northeast-2
  • ap-south-1

See Features with limited regional availability

Salesforce Data Cloud File Sharing connector GA​

August 22, 2025

The Salesforce Data Cloud File Sharing connector is now generally available.

See Lakehouse Federation for Salesforce Data Cloud File Sharing.

Enhanced autocomplete for complex data types in notebooks​

August 22, 2025

Notebook autocomplete now supports enhanced suggestions for complex data types including structs, maps, and arrays in SQL cells. Additionally, when referencing common table expressions (CTEs) that use SELECT *, autocomplete provides column recommendations based on the underlying table structure.

See Personalized autocomplete.

Databricks Asset Bundles support for Lakebase database resources​

August 21, 2025

You can now define Lakebase database catalogs, instances, and synced tables in a bundle. This means you can deploy a full database environment with one command instead of setting up resources separately.

When you deploy a bundle with a database instance, the instance starts running immediately.

See database_catalogs, database_instances, and synced_database_table.

Databricks Assistant integrated with compute​

August 21, 2025

Users can now chat with Databricks Assistant on some compute pages. Use the Assistant chat panel to help you create a new compute resource, pool, and policy. Or, ask the Assistant questions about the compute resource, like “Is this compute resource Unity Catalog-enabled?” or “What’s the current compute policy?”

To learn more about chatting with the Assitant, see Tour of the Assistant pane. To learn more about compute resources, see Compute.

Serverless compute runtime updated to 17.1​

August 19, 2025

Serverless compute for notebooks, jobs, and Lakeflow Declarative Pipelines now uses an upgraded runtime, which roughly corresponds to Databricks Runtime 17.1. See Serverless compute release notes.

Set the run-as user for Lakeflow Declarative Pipelines​

August 18, 2025

You can now change the identity that a pipeline uses to run updates and the owner of tables published by the pipeline. This feature allows you to set a service principal as the run-as identity, which is safer and more reliable than using user accounts for automated workloads. Common use cases include recovering pipelines when the original owner was deactivated and deploying pipelines with service principals as a best practice.

For information about setting the run-as user, see Set the run-as user.

Mosaic AI Vector Search reranker Public Preview​

August 15, 2025

Mosaic AI Vector Search now offers reranking to help improve retrieval quality. For details, see Use the reranker in a query.

Lakeflow Declarative Pipelines template in bundles in the workspace (Public Preview)​

August 14, 2025

You can now easily create an ETL pipeline in a bundle in the workspace using the new Lakeflow Declarative Pipelines template project.

See Create ETL pipeline.

Token-based rate limits now available on AI Gateway​

August 14, 2025

You can now configure token-based rate limits on your model serving endpoints.

See Configure AI Gateway on model serving endpoints for how to configure token-based rate limits.

Databricks-hosted models for Assistant are now GA​

August 14, 2025

Databricks Assistant with Databricks-hosted models is now generally available on all cloud platforms. This version of the Assistant is fully powered by models hosted and served directly on Databricks infrastructure — at no additional cost to customers.

See Use Databricks-hosted models for AI-powered features.

OpenAI GPT OSS models now support function calling​

August 13, 2025

The Databricks-hosted foundation models, OpenAI GPT OSS 120B and GPT OSS 20B now support function and tool calling.

See Function calling on Databricks.

OpenAI GPT OSS models now supported on provisioned throughput​

August 13, 2025

The Databricks-hosted foundation models, OpenAI GPT OSS 120B and GPT OSS 20B are now supported on Provisioned throughput Foundation Model APIs.

Serverless GPU compute now supports multinode workloads​

August 13, 2025

Serverless GPU compute now supports multinode workloads. See Serverless GPU compute.

Schedule jobs for Serverless GPU compute workloads​

August 13, 2025

You can now create and schedule jobs for your Serverless GPU Compute workloads. See Create and schedule a job.

Databricks Assistant: User and workspace instructions now available​

August 12, 2025

You can now tailor how Databricks Assistant responds by adding custom user instructions. Guide the Assistant with preferences, coding conventions, and response guidelines.

Admins can also add workspace-wide instructions, which take priority over user instructions.

Instructions apply across Assistant experiences like Inline Assistant, General Chat, Suggest Fix, and Edit mode. See Customize and improve Databricks Assistant responses.

Single-node compute on standard access mode is now GA​

August 12, 2025

Single node compute resources with standard access mode is now generally available. This configuration allows multiple users to share a single-node compute resource with full user isolation. Single-node compute is useful for small jobs or non-distributed workloads.

See Compute configuration reference.

Column masks now retained when replacing a table​

August 12, 2025

If a column in the new table matches a column name from the original table, its existing column mask is now retained, even if no mask is specified. This change prevents accidental removal of column-level security policies during table replacement. Previously, replacing a table dropped all existing column masks, and only newly defined masks were applied.

This change affects SQL commands ([CREATE OR] REPLACE TABLE), DataFrame APIs (saveAsTable, replace, createOrReplace), and other similar update table operations.

See Manually apply row filters and column masks.

Access requests in Unity Catalog (Public Preview)​

August 11, 2025

You can now enable self-service access requests in Unity Catalog by configuring access request destinations on securable objects.

Users can request access to Unity Catalog objects that they discover. These requests are sent to configured destinations, such as emails, Slack or Microsoft Teams channels, or they can be redirected to an internal access management system.

You can also enable default email destinations so requests automatically go to the catalog or object owner’s email if no other destination is set. This ensures that access requests are delivered even when no destination is manually configured for an object.

See Manage access request destinations.

Disable legacy features for new workspaces (Public Preview)​

August 11, 2025

A new account console setting allows account admins to disable certain legacy features on new workspaces created in their account. If set, new workspaces will not include DBFS root and mounts, the Hive metastore, no-isolation shared compute, or Databricks Runtime versions prior to 13.3 LTS. If needed, workspace admins can still enable these legacy features from their workspace settings.

See Disable access to legacy features in new workspaces.

Lakebase Public Preview enabled by default​

August 11, 2025

The Lakebase: Managed Postgres OLTP Database preview is now enabled by default. Users can start creating Lakebase database instances without needing workspace admins to enable this preview first. Admins can disable the preview if needed.

See Create and manage a database instance and Manage Databricks Previews.

Serverless workspaces are now Public Preview​

August 11, 2025

Serverless workspaces come pre-configured with serverless compute and default storage to provide a completely serverless experience. Account admins can enable the serverless workspaces Public Preview in the account console. See Create a serverless workspace.

ServiceNow connector GA​

August 8, 2025

The fully-managed ServiceNow ingestion connector in Lakeflow Connect is now generally available. See Configure ServiceNow for Databricks ingestion.

Create external Delta tables from third-party clients (Public Preview)​

August 8, 2025

You can now create Unity Catalog external tables backed by Delta Lake from external clients and systems, such as Apache Spark.

See Create external Delta tables from external clients.

Path credential vending (Public Preview)​

August 8, 2025

You can now use path credential vending to grant short-lived credentials to external locations in your Unity Catalog metastore. See Unity Catalog credential vending for external system access.

Use OpenAI GPT OSS models for batch inference and structured outputs​

August 7, 2025

The Databricks-hosted foundation models, OpenAI GPT OSS 120B and GPT OSS 20B are now optimized for AI Functions, which means you can perform batch inference using these models and AI Functions like ai_query(). Inference workloads that use these models also now support specifying structured outputs.

Serverless compute is now available in ap-southeast-3​

August 6, 2025

Serverless compute for notebooks, workflows, and Lakeflow Declarative Pipelines is now available in the Asia Pacific (Jakarta) region (ap-southeast-3). See Features with limited regional availability.

Databricks ODBC driver 2.9.2​

August 5, 2025

The Databricks ODBC Driver version 2.9.2 is now available for download from the ODBC driver download page.

This release includes the following fixes and new features:

  • The process name is now used as the default UserAgentEntry if the UserAgentEntry is not explicitly set.
  • Added support for Databricks domains cloud.databricks.us and cloud.databricks.mil.
  • Enhanced recognition and handling of timestamp_ntz columns across multiple data source functions including SQLGetTypeInfo, SQLColumns, and SQLColAttribute.
  • Added CRL (Certificate Revocation Lists) cache support on Windows when UseSystemTruststore is enabled.
  • Added VOID type column support, so that VOID columns are now correctly listed in SQLGetColumns.
  • Enabled OAuth Token exchange for IDPs different from the host, which allows the exchange of OAuth access tokens (including BYOT) for Databricks in-house tokens.
  • Added support for Windows Server 2025.
  • Fixed a memory leak in the driver.

This release includes upgrades to several third-party libraries:

  • OpenSSL upgraded from 3.0.15 to 3.0.16
  • libcURL upgraded from 8.11.0 to 8.12.1
  • Expat upgraded from 2.6.3 to 2.7.1

This release includes the following behavior changes:

  • The connector no longer supports Databricks Runtime version 10.4 LTS.
  • The default maximum catalog name length and maximum schema name length has been changed from 128 to 1024.
  • Ubuntu 20.04 is no longer supported.

For complete configuration information, see the Databricks ODBC Driver Guide installed with the driver download package.

Power BI Databricks connector supports M2M OAuth​

August 5, 2025

You can now authenticate into Power BI Desktop using Machine-to-Machine (M2M) OAuth credentials. If you are currently using personal access tokens on behalf of service principals, Databricks recommends switching to the new Client credentials authentication option.

See Configure service principals on Databricks for Power BI.

OpenAI GPT OSS models now available on Mosaic AI Model Serving​

August 5, 2025

Mosaic AI Model Serving now supports OpenAI's GPT OSS 120B and GPT OSS 20B as Databricks-hosted foundation models. You can access these models using Foundation Model APIs pay-per-token.

August 4, 2025

You can now enable AWS PrivateLink to resources in your VPC (virtual private cloud) through an NLB (network load balancer) from serverless compute. See Configure private connectivity to resources in your VPC.

Jobs in continuous mode can now have task-level retries for failed tasks​

August 11, 2025

Jobs that are set to run in continuous mode now have the option to retry individual tasks on task failure.

See Run jobs continuously.

Databricks Runtime 17.1 is now is now GA​

August 1, 2025

Databricks Runtime 17.1 is now generally available. See Databricks Runtime 17.1.

AI Playground is now GA​

August 1, 2025

AI Playground is now GA. See Chat with LLMs and prototype generative AI apps using AI Playground.

Edit mode in Assistant does multi-cell code refactoring and more​

August 1, 2025

Databricks Assistant now supports edit mode, which performs reasoning and editing steps across multiple cells in a notebook. Edit mode handles complex, multi-step tasks efficiently, coordinating changes across multiple cells without requiring manual intervention or repetitive prompting.

For information about using Assistant on code, see Get coding help from Databricks Assistant.

Last updated on