With declarative feature engineering, you can:

• Define features in Unity Catalog.
• Materialize batch features to Delta tables or Lakebase.
• Serve Unity Catalog models using online model serving.

See Declarative feature engineering and managed pipelines and Materialize and serve declarative features.

See Transactions.

For a full list of supported compliance standards, see Compliance security profile.

To access this model, use:

• Foundation Model APIs pay-per-token
  • Query vision models
• Batch inference workloads using AI Functions

See Persist custom model serving data to Unity Catalog.

See Configure telemetry for Databricks Apps.

Customers are responsible for ensuring their compliance with the terms of OpenAI's Acceptable Use Policy.

See Tree view of the workspace browser side panel (Public Preview).

See Lakebase Autoscaling limitations.

To continue using automated downloads, migrate to the Databricks ODBC driver before March 27, 2026. See Migrate from Simba Spark ODBC Driver to Databricks ODBC Driver.

Use Agent Bricks: Knowledge Assistant to create a chatbot that can answer questions about your documents and provide high-quality responses with citations.

See Use Agent Bricks: Knowledge Assistant to create a high-quality chatbot over your documents.

See Install an external MCP server.

See High availability.

• ca-central-1 (Canada Central)
• eu-west-2 (Europe – London)
• sa-east-1 (South America – São Paulo)

See Get started with Lakebase Autoscaling.

February 27, 2026

This serverless compute release roughly corresponds to Databricks Runtime 18.0.

New features

• SQL scripting is now generally available: SQL scripting is now generally available.

• Redshift JDBC driver upgraded to 2.1.0.28: The Redshift JDBC driver has been upgraded to version 2.1.0.28.

• Shared isolation execution environment for Unity Catalog Python UDFs: Unity Catalog Python UDFs with the same owner can now share an isolation environment by default, improving performance and reducing memory usage. To ensure a UDF always runs in a fully isolated environment, add the STRICT ISOLATION characteristic clause. See Environment isolation.

• SQL window functions in metric views: You can now use SQL window functions in metric views to calculate running totals, rankings, and other window-based calculations.

• Dynamic shuffle partition adjustment in stateless streaming queries: You can now change the number of shuffle partitions in stateless streaming queries without restarting the query.

• Adaptive Query Execution and auto-optimized shuffle in stateless streaming queries: Adaptive Query Execution (AQE) and auto-optimized shuffle (AOS) are now supported in stateless streaming queries.

• Literal string coalescing everywhere: The ability to coalesce sequential string literals such as 'Hello' ' World' into 'Hello World' has been expanded to any place string literals are allowed. See STRING type.

• Parameter markers everywhere: You can now use named (:param) and unnamed (?) parameter markers virtually anywhere a literal value of the appropriate type can be used, including DDL statements and column types. See Parameter markers.

• IDENTIFIER clause everywhere: The IDENTIFIER clause, which casts strings to SQL object names, has been expanded to nearly everywhere an identifier is permitted, including column aliases and column definitions. See IDENTIFIER clause.

• New BITMAP_AND_AGG function: A new bitmap_and_agg aggregate function function is now available.

• New Theta sketch functions: A new library of functions for approximate distinct count and set operations using Datasketches Theta Sketch is now available, including theta_sketch_agg, theta_union_agg, theta_intersection_agg, and related functions.

• New KLL Sketch function library: A new library of functions for building KLL Sketches for approximate quantile computation is now available, including kll_sketch_agg_bigint, kll_sketch_agg_double, and related functions.

• Apache Parquet library upgraded to 1.16.0: The Apache Parquet library has been upgraded to version 1.16.0.

• New geospatial functions: The following new geospatial functions are now supported:

  • st_azimuth function: Returns the north-based azimuth from the first point to the second in radians.
  • st_boundary function: Returns the boundary of the input geometry.
  • st_closestpoint function: Returns the 2D projection of a point on the first geometry closest to the second geometry.
  • st_geogfromewkt function: Parses an Extended Well-Known Text (EWKT) description of a geography.
  • st_geomfromewkt function: Parses an Extended Well-Known Text (EWKT) description of a geometry.

• Improved spatial join performance: Spatial join performance is now improved by introducing shuffled spatial join support.

• Improved performance for geospatial functions: Photon implementations are now available for st_isvalid function, st_makeline function, and st_makepolygon function.

• EWKT input support: The try_to_geography, try_to_geometry, to_geography, and to_geometry functions now accept Extended Well-Known Text (EWKT) as input.

Behavior changes

• FSCK REPAIR TABLE includes metadata repair by default: The FSCK REPAIR TABLE command now includes an initial metadata repair step before checking for missing data files. The command can work on tables with corrupt checkpoints or invalid partition values.

• Proration factors aligned between reads and auto-optimized writes: Proration factors for partition sizing now use fractional values consistently across read operations and auto-optimized writes. This change might result in a different number of tasks for read operations.

• Python UDF execution unified across PySpark and Unity Catalog: Unity Catalog Python UDFs now use Apache Arrow as the default interchange format, improving overall performance. As part of this change, TIMESTAMP values passed to Python UDFs no longer include timezone information in the datetime object's tzinfo attribute. If your UDF relies on timezone information, restore it with date = date.replace(tzinfo=timezone.utc). See Timestamp timezone behavior for inputs.

• Improved error messages for Kafka connector login module issues: When using the Kafka connector with an unshaded login module class, Databricks now provides error messages that suggest using the correct shaded class prefix (kafkashaded.org.apache.kafka or kafkashaded.software.amazon.msk.auth.iam).

• Time travel restrictions and VACUUM retention behavior: Databricks now blocks time travel queries beyond the deletedFileRetentionDuration threshold for all tables. The VACUUM command ignores the retention duration argument except when the value is 0 hours. You can't set deletedFileRetentionDuration larger than logRetentionDuration or vice versa.

• BinaryType maps to bytes by default in PySpark: In PySpark, BinaryType now consistently maps to Python bytes. Previously, PySpark mapped BinaryType to either bytes or bytearray depending on the context. To restore the old behavior, set spark.sql.execution.pyspark.binaryAsBytes to false.

• NULL structs preserved in Delta MERGE, UPDATE, and streaming write operations: NULL structs are now preserved as NULL in Delta MERGE, UPDATE, and streaming write operations that include struct type casts. Previously, NULL structs were expanded to structs with NULL fields.

• Partition columns materialized in Parquet files: Partitioned Delta tables now materialize partition columns in newly written Parquet data files. Previously, partition values were stored in the Delta transaction log metadata and reflected in directory paths, but not written as columns in the Parquet files themselves. This change might affect workloads that directly read Parquet files written by Delta.

• DESCRIBE TABLE output includes metadata column: The output of DESCRIBE TABLE [EXTENDED] now includes a new metadata column for all table types, containing semantic metadata (display name, format, and synonyms) defined on the table as a JSON string.

• Databricks Runtime 18.0
• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

Customers are responsible for ensuring their compliance with the terms of OpenAI's Acceptable Use Policy.

See the VPC Endpoints API and Manage VPC endpoint registrations.

• Assistant chat and cell actions
• Genie spaces (excluding research agent)
• AI generated comments
• AI/BI dashboards

Workspaces in Brazil, Canada, Japan, Korea, and the UK will soon be able to use these features with Enforce data processing within workspace Geography for Designated Services enabled and partner-powered AI features enabled. For these features in the affected countries, in-country data routing will be enforced, meaning data will not leave the country.

If partner-powered AI features is disabled, the Assistant can use Databricks-hosted models only if Enforce data processing within workspace Geography for Designated Services is disabled.

All other designated services continue to comply with data residency managed by Databricks Geos. Some AI capabilities that depend on models not currently hosted in these countries might no longer be available when Enforce data processing within workspace Geography for Designated Services is enabled. See Databricks Geos: Data residency for more information on which features require cross-geo processing.

See COMMENT ON.

To access this model, use:

• Foundation Model APIs pay-per-token
  • Query reasoning models
  • Query vision models
• Batch inference workloads using AI Functions

• Databricks Runtime 18.0
• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

• Domains: Business-aligned organization layer that groups data assets by functional area (for example, Marketing, or Finance) to improve discovery and stewardship
• Custom curation: Curators can customize and highlight specific assets in their organization or domain
• AI-powered recommendations: Surface popular and valuable datasets to enable curation at scale
• Unified discovery: Access tables, dashboards, Genie spaces, and more in one place

Domains are built on governed tags, allowing you to organize data assets in a way that's best suited for your business needs.

See Databricks Runtime 18.1 (Beta) and Databricks Runtime 18.1 for Machine Learning (Beta).

See AI Gateway (Beta).

When you create an external location using the UI, Databricks checks for the required permissions and guides you to fix any issues or proceed with a force create. This check does not run in the API, but ingestion pipelines automatically fall back to prevent breakage.

You can disable file events for an external location after creation if needed. For more information, see Set up file events for an external location.

SQL scripting is generally available

SQL scripting is now generally available. Write procedural logic with SQL, including conditional statements, loops, local variables, and exception handling.

Parameter markers now supported in more SQL contexts

You can now use named (:param) and unnamed (?) parameter markers anywhere a literal value of the appropriate type is allowed. This includes DDL statements such as CREATE VIEW v AS SELECT ? AS c1, column types such as DECIMAL(:p, :s), and comments such as COMMENT ON t IS :comment. This allows you to parameterize a large variety of SQL statements without exposing your code to SQL injection attacks. See Parameter markers.

IDENTIFIER clause expanded to more SQL contexts

The IDENTIFIER clause, which casts strings to SQL object names, is now supported in nearly every context where an identifier is permitted. Combined with expanded parameter marker and literal string coalescing support, you can parameterize anything from column aliases (AS IDENTIFIER(:name)) to column definitions (IDENTIFIER(:pk) BIGINT NOT NULL). See IDENTIFIER clause.

Literal string coalescing supported everywhere

Sequential string literals such as 'Hello' ' World' now coalesce into 'Hello World' in any context where string literals are allowed, including COMMENT 'This' ' is a ' 'comment'. See STRING type.

New BITMAP_AND_AGG function

A new BITMAP_AND_AGG function is now available to complement the existing library of BITMAP functions.

New Theta Sketch functions for approximate distinct counts

A new library of functions for approximate distinct count and set operations using Datasketches Theta Sketch is now available:

• theta_sketch_agg aggregate function
• theta_union_agg aggregate function
• theta_intersection_agg aggregate function
• theta_sketch_estimate function
• theta_union function
• theta_difference function
• theta_intersection function

New KLL Sketch functions for approximate quantiles

A new library of functions for building KLL Sketches for approximate quantile computation is now available:

• kll_sketch_agg_bigint aggregate function
• kll_sketch_get_quantile_bigint function
• kll_sketch_merge_bigint function
• kll_sketch_agg_double aggregate function
• kll_sketch_get_quantile_double function
• kll_sketch_merge_double function
• kll_sketch_agg_float aggregate function
• kll_sketch_get_quantile_float function
• kll_sketch_merge_float function
• kll_sketch_get_n_bigint function
• kll_sketch_get_rank_bigint function
• kll_sketch_to_string_bigint function
• kll_sketch_get_n_double function
• kll_sketch_get_rank_double function
• kll_sketch_to_string_double function
• kll_sketch_get_n_float function
• kll_sketch_get_rank_float function
• kll_sketch_to_string_float function

You can merge multiple KLL sketches in an aggregation context using kll_merge_agg_bigint, kll_merge_agg_double, and kll_merge_agg_float.

SQL window functions in metric views

You can now use SQL window functions in metric views to calculate running totals, rankings, and other window-based calculations.

New geospatial functions

The following new geospatial functions are now available:

• st_azimuth function: Returns the north-based azimuth from the first point to the second in radians in [0, 2π).
• st_boundary function: Returns the boundary of the input geometry.
• st_closestpoint function: Returns the 2D projection of a point on the first geometry that is closest to the second geometry.
• st_geogfromewkt function: Parses an Extended Well-Known Text (EWKT) description of a geography.
• st_geomfromewkt function: Parses an Extended Well-Known Text (EWKT) description of a geometry.

EWKT input support for existing geometry and geography functions

The following functions now accept Extended Well-Known Text (EWKT) as input:

• try_to_geography function
• try_to_geometry function
• to_geography function
• to_geometry function

Improved geospatial function performance

Spatial join performance is improved with shuffled spatial join support. The following ST functions now have Photon implementations:

• st_isvalid function
• st_makeline function
• st_makepolygon function

FSCK REPAIR TABLE includes metadata repair by default

FSCK REPAIR TABLE now includes an initial metadata repair step before checking for missing data files, allowing it to work on tables with corrupt checkpoints or invalid partition values. Additionally, the dataFilePath column in the FSCK REPAIR TABLE DRY RUN output schema is now nullable to support new issue types where the data file path is not applicable.

DESCRIBE TABLE output includes metadata column

The output of DESCRIBE TABLE [EXTENDED] now includes a metadata column for all table types. This column contains semantic metadata (display name, format, and synonyms) defined on the table as a JSON string.

NULL structs preserved in MERGE, UPDATE, and streaming write operations

NULL structs are now preserved as NULL in Delta Lake MERGE, UPDATE, and streaming write operations that include struct type casts. Previously, NULL structs were expanded to structs with all fields set to NULL.

Partition columns materialized in Parquet files

Partitioned Delta Lake tables now materialize partition columns in newly written Parquet data files. Previously, partition values were stored only in the Delta Lake transaction log metadata. Workloads that directly read Parquet files written by Delta Lake sees additional partition columns in newly written files.

Timestamp partition values respect session timezone

Timestamp partition values are now correctly adjusted using the spark.sql.session.timeZone configuration. Previously, they were incorrectly converted to UTC using the JVM timezone.

Time travel restrictions updated

Databricks now blocks time travel queries beyond the deletedFileRetentionDuration threshold for all tables. The VACUUM command ignores the retention duration argument except when the value is 0 hours. You cannot set deletedFileRetentionDuration larger than logRetentionDuration.

SHOW TABLES DROPPED respects LIMIT clause

SHOW TABLES DROPPED now correctly respects the LIMIT clause.

See Configure default Python package repositories for more details.

See Using a provided queue.

Use Agent Bricks: Supervisor Agent to create a multi-agent supervisor system that orchestrates AI agents and tools to work together on complex tasks.

See Use Agent Bricks: Supervisor Agent to create a coordinated multi-agent system.

Supervisor Agent is now Generally Available in select US regions for workspaces without Enhanced Security and Compliance features. For workspaces that have the compliance security profile enabled and HIPAA controls selected, Supervisor Agent will be Generally Available soon. See What's coming.

See ALTER STREAMING TABLE and ALTER MATERIALIZED VIEW. For general information about using ALTER with Lakeflow Spark Declarative Pipelines, see Use ALTER statements with pipeline datasets.

To access this model, use:

• Foundation Model APIs pay-per-token
  • Query reasoning models
  • Query vision models
• Batch inference workloads using AI Functions

See Connect Databricks Assistant to MCP servers.

See Availability of Designated Services in each Geo for more information on which features require cross-geo processing.

See Availability of Designated Services in each Geo for more information on which features require cross-geo processing.

See Schedule materialized view refreshes and Change the schedule for a streaming table for more information.

For a reference of these tables, see Jobs system table reference.

Customers are responsible for ensuring their compliance with the terms of OpenAI's Acceptable Use Policy.

See Configure the compute size for a Databricks app.

App compute sizing is coming soon to workspaces with the compliance security profile enabled.

• Databricks Runtime 18.0
• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 17.1
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

Users in these regions can now use Agent Bricks: Knowledge Assistant to create a production-grade AI agent that can answer questions about their documents and provide high-quality responses with citations.

See Use Agent Bricks: Knowledge Assistant to create a high-quality chatbot over your documents.

• Store unlimited traces in Delta tables for long-term retention and analysis
• Query trace data directly using SQL through a Databricks SQL warehouse
• Manage access control through Unity Catalog schema and table permissions
• Ensure compatibility with other OpenTelemetry clients and tools

See Store MLflow traces in Unity Catalog and Query MLflow traces using MLflow Databricks SQL.

See Get started with Lakebase Postgres.

For more information, see Manage serverless workspace base environments.

• Prompt matching (previously value sampling)
• Format assistance (previously example values)
• Entity matching (previously value dictionaries)

If you prefer to continue using ODBC for new connections, you will have two options:

1. When creating a connection, select default as the Implementation.
2. In Power BI Desktop, disable the ADBC feature preview, which will restore ODBC as the default for all new connections.

To learn more about ADBC, see Configure ADBC or ODBC driver for Power BI and the Databricks Driver in the ADBC repository.

Previous versions of the driver will continue to be available on the All ODBC Driver Versions page and will remain supported for at least two years.

Knowledge Assistant is now generally available in select US regions for workspaces without Enhanced Security and Compliance features.

This feature is available for the Google Analytics, Salesforce, and ServiceNow connectors.

See Select rows to ingest.

Customers are responsible for ensuring their compliance with the terms of OpenAI's Acceptable Use Policy.

• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 17.1
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

See Clock-hour-aligned slicing logic.

See Extend the Assistant with agent skills.

• The agent can automate multiple steps. From a single prompt, it can retrieve relevant assets, generate and run code, fix errors automatically, and visualize results. It adds the ability to sample data and cell outputs to provide better results.
• The Assistant in Agent Mode will choose between Azure OpenAI or Anthropic on Databricks (uses endpoints hosted by Databricks Inc. in AWS within the Databricks security perimeter), and is only available when the partner-powered AI features setting is enabled.
• Admins can disable the preview if needed until the feature reaches General Availability.

See Use the Data Science Agent, the blog post, and Partner-powered AI features.

This behavior enforces the Disable legacy features account setting available in existing Databricks accounts. See Disable access to legacy features in new workspaces.

Contact your Databricks account team to request access to the preview.

For more details, see View last successful run and update notebook.

See Context-based ingress control.

If you use Databricks on AWS GovCloud, contact your account team to receive access to the driver.

Simplified navigation:

The duplicative Catalogs tab is removed to reduce redundancy and focus on a single catalog navigation surface. DBFS and Send feedback actions move into the kebab menu for a cleaner layout.

New Suggested section:

A new Suggested tab on the Catalog Explorer landing page highlights frequently used objects, example objects for first-time users, and user favorites. This helps you quickly re-engage with important assets or discover helpful starting points.

Consolidated entry points:

Related capabilities are grouped under clearer categories to reduce visual noise and improve findability:

• Govern – Entry point for governed tags, metastore administration, and data classification
• Connect – Entry points for external locations, external data, credentials, and connections
• Share – Entry points for Delta Sharing and Clean Rooms

These groupings replace scattered sub-tabs and create a more intuitive, scalable information architecture.

• Disable legacy features: Account-level setting that disables access to DBFS, Hive Metastore, and No-isolation shared compute in new workspaces.
• Disable access to Hive metastore: Workspace-level setting that disables access to the Hive metastore used by your workspace.

For an in-depth comparison of the SharePoint connectors, see Choose your SharePoint connector.

To start using Auto Loader with file events, see the following:

• (Prerequisite) Enable file events for an external location
• File notification mode with and without file events enabled on external locations

Recipient tokens created on or after March 9, 2026:

Starting March 9, 2026, new open recipient tokens will use a new, recipient-specific URL format to improve security and network filtering. This change applies to tokens issued on or after this date; earlier tokens can continue to use the older URL format until they expire. See New token expiration lifetime policy in the following section.

For AWS GovCloud and AWS GovCloud DoD, the transition will be announced later.

For OIDC, recipients must transition to the new URL format by March 9, 2027. Starting March 9, 2026, providers will be able to view the new URL format for existing recipients in the Delta Sharing page to share with recipients.

The new URLs will be in the following format:

https://2d4b0370-9d5c-4743-9297-72ba0f5caa8d.delta-sharing.us-west-2.cloud.databricks.com

New token expiration lifetime policy:

Starting December 8, 2025, all new open sharing recipient tokens will be issued with a maximum expiration of one year from the date of creation. Tokens with longer or unlimited validity can no longer be created.

For tokens created using the previous recipient URL format between December 8, 2025 and March 9, 2026, each token automatically expires one year after its creation. When rotating tokens, providers can configure a downtime window to allow recipients to migrate. During this window, both the old and new recipient URLs continue to work.

If you currently use recipient tokens with long or unlimited lifetimes, review your integrations and remember to rotate tokens annually as needed as tokens will expire on December 8, 2026.

These changes include:

• Time travel queries are blocked if they exceed delta.deletedFileRetentionDuration.
• delta.logRetentionDuration must be greater than or equal to delta.deletedFileRetentionDuration.

See Use ForEachBatch to write to arbitrary data sinks in pipelines.

See Databricks Runtime 18.0 and Databricks Runtime 18.0 for Machine Learning.

• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 17.1
• Databricks Runtime 17.0
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

jobs table: trigger, trigger_type, run_as_user_name, creator_user_name, paused, timeout_seconds, health_rules, deployment, create_time

job_tasks table: timeout_seconds, health_rules

job_run_timeline table: source_task_run_id, root_task_run_id, compute, termination_type, setup_duration_seconds, queue_duration_seconds, run_duration_seconds, cleanup_duration_seconds, execution_duration_seconds

job_task_run_timeline table: compute, termination_type, task_parameters, setup_duration_seconds, cleanup_duration_seconds, execution_duration_seconds

pipelines table: create_time

These columns are not populated for rows emitted before early December 2025. See Jobs system table reference.

Existing open sharing recipient tokens issued before December 8, 2025, with expiration dates after December 8, 2026, or with no expiration date, automatically expire on December 8, 2026. If you currently use recipient tokens with long or unlimited lifetimes, review your integrations and renew tokens as needed to avoid breaking changes after this date.

See Create a recipient object for non-Databricks users using bearer tokens (open sharing).

See Monitor and revoke personal access tokens.

To access this model, use:

• Foundation Model APIs pay-per-token
  • Query reasoning models
  • Query vision models
• Batch inference workloads using AI Functions

See Create a classic workspace.

To access this model, use:

• Foundation Model APIs pay-per-token
  • Query reasoning models
  • Query vision models
• Batch inference workloads using AI Functions

• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 17.1
• Databricks Runtime 17.0
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

See Manage network policies for serverless egress control.

See Add tables and schemas secured by ABAC policies to a share and Read ABAC-secured data and apply ABAC policies.

• Foundation Model APIs pay-per-token
  • Query reasoning models
  • Query vision models
• Batch inference workloads using AI Functions

Minimum Databricks Runtime versions:

• ALTER TABLE SET MANAGED: DBR 17.3 LTS or above
• ALTER TABLE SET EXTERNAL: DBR 17.0 LTS or above
• ALTER CATALOG DROP CONNECTION: DBR 17.3 LTS or above
• ALTER SCHEMA SET MANAGED LOCATION: DBR 16.4 LTS or above

• Governed access to data sources using Unity Catalog connections
• Create the connection one time and reuse it across any Unity Catalog compute type: serverless, standard clusters, dedicated clusters, and Databricks SQL
• Stable for Spark and compute upgrades
• Connection credentials are hidden from the querying user

The JDBC connection is available on Databricks Runtime 17.3 and above on standard or dedicated access mode, or on serverless compute. For more information, see JDBC connection.

See Share data between SAP Business Data Cloud (BDC) and Databricks.

See List your data product in Databricks Marketplace and Get access to external MCP servers.

See Model Context Protocol (MCP) on Databricks.

• Databricks Runtime 17.3 LTS
• Databricks Runtime 17.2
• Databricks Runtime 17.1
• Databricks Runtime 17.0
• Databricks Runtime 16.4 LTS
• Databricks Runtime 15.4 LTS
• Databricks Runtime 14.3 LTS
• Databricks Runtime 13.3 LTS
• Databricks Runtime 12.2 LTS

• See Function calling on Databricks
• See Structured outputs on Databricks

In Public Preview, ABAC includes two key changes from the Beta:

• Account-level enforcement: ABAC has transitioned from a workspace-level preview to an account-level preview. ABAC policies are now enforced across all workspaces attached to an account’s metastore by default. See ABAC Beta to Public Preview transition.

• Automatic type casting for column masks: Databricks now automatically casts the output of column mask functions defined in ABAC policies to match the target column’s data type. This ensures consistent typing and more reliable query behavior. Existing column mask functions might fail if their return types are incompatible with the target column’s type. See ABAC column mask type casting

For more information, see Unity Catalog attribute-based access control (ABAC).

See Step into workspace files.

EXECUTE IMMEDIATE using constant expressions

You can now pass constant expressions as the SQL string and as arguments to parameter markers in EXECUTE IMMEDIATE statements.

LIMIT ALL support for recursive CTEs

You can now use LIMIT ALL to remove the total size restriction on recursive common table expressions (CTEs).

st_dump function support

You can now use the st_dump function to get an array containing the single geometries of the input geometry. See st_dump function.

Polygon interior ring functions are now supported

You can now use the following functions to work with polygon interior rings:

• st_numinteriorrings: Get the number of inner boundaries (rings) of a polygon. See st_numinteriorrings function.
• st_interiorringn: Extract the n-th inner boundary of a polygon and return it as a linestring. See st_interiorringn function.

Support MV/ST refresh information in DESCRIBE EXTENDED AS JSON

Databricks now generates a section for materialized view and streaming table refresh information in the DESCRIBE EXTENDED AS JSON output, including last refreshed time, refresh type, status, and schedule.

Add metadata column to DESCRIBE QUERY and DESCRIBE TABLE

Databricks now includes a metadata column in the output of DESCRIBE QUERY and DESCRIBE TABLE for semantic metadata.

For DESCRIBE QUERY, when describing a query with metric views, semantic metadata propagates through the query if dimensions are directly referenced and measures use the MEASURE() function.

For DESCRIBE TABLE, the metadata column appears only for metric views, not other table types.

Correct handling of null structs when dropping NullType columns

When writing to Delta tables, Databricks now correctly preserves null struct values when dropping NullType columns from the schema. Previously, null structs were incorrectly replaced with non-null struct values where all fields were set to null.

See Get started with Lakebase Postgres (Autoscaling Beta).

See Create and manage compute policies and Compute policy reference.

See Use Agent Bricks: Supervisor Agent to create a coordinated multi-agent system.

• See Query reasoning models.
• See Apply AI on data using Databricks AI Functions for guidance on how to use the Gemini 2.5 models for batch inference.

See AWS Capacity Blocks

New features

The connector now supports Kerberos with proxy connections. To enable Kerberos proxy, set UseProxy=1 and ProxyAuth=2. To set proxy details, use ProxyHost, ProxyPort, ProxyKrbRealm, ProxyKrbFQDN, and ProxyKrbService.

Resolved issues

• Fixed an issue where the connector failed to run complex queries that contained ? characters in native mode.
• Fixed intermittent failures in Unity Catalog volume ingestion caused by unexpected connector behavior.
• Fixed an assertion error in getColumns when a table included a column of type Void or Variant and the java -ea flag was enabled.

Qwen3-Next 80B A3B Instruct is available in Beta. See Manage Databricks previews for guidance on how to enable this model based on your Databricks plan tier.

See Compatibility Mode.

Existing tables continue to use their current compression codec. To change the compression codec for an existing table, set the delta.parquet.compression.codec table property. See Table properties reference.

See What changes are in the Unified Runs List preview?.

See Databricks Connector for Google Sheets.

See Manage dashboard tags and Add tags.

See Collaborate on bundles in the workspace.

This multimodal support is available using the following functionalities:

• Foundation Model APIs pay-per-token.
• Foundation Model APIs provisioned throughput.
• AI Functions. Both real-time inference and batch inference workloads.

See Context-based ingress control.

For billing log reference, see Billable usage system table reference.

See Databricks Runtime 17.3 LTS and Databricks Runtime 17.3 LTS for Machine Learning.

These models are optimized for AI Functions, which means you can perform batch inference using these models and AI Functions like ai_query().

For real-time inference workloads, see the following pages:

• Query a chat model
• Query reasoning models
• Query vision models
• Function calling

For details, see Apply row filters and column masks.

• Thinking messages content in the messages.content array.
• Images content blocks in the messages.content array.
• Tool use, results and definitions in the tools array.

See Foundation model REST API reference.

• The cell execution minimap now appears in the right margin of notebooks. Use the minimap to get a visual overview of your notebook's run status and quickly navigate between cells. See Cell execution minimap.
• Use Databricks Assistant to help diagnose and fix environment errors, including library installation errors. See Debug environment errors.
• When reconnecting to serverless notebooks, sessions are automatically restored with the notebook's Python variables and Spark state. See Automated session restoration for serverless notebooks.
• Pyspark authoring completion now supports agg, withColumns, withColumnsRenamed, and filter/where clauses. See Get inline code suggestions: Python and SQL examples.
• Databricks now supports importing and exporting IPYNB notebooks up to 100 MB. Revision snapshot autosaving, manual saving, and cloning are supported for all notebooks up to 100 MB. See Notebook sizing.
• When cloning and exporting notebooks, you can now choose whether to include cell outputs or not. See Manage notebook format.

• See Use ai_query with foundation models for an example.
• See Supported foundation models on Mosaic AI Model Serving for region availability.

To use semantic metadata, your metric view must use YAML specification version 1.1 or higher and run on Databricks Runtime 17.2 or above. The corresponding Databricks SQL version is 2025.30, available in the Preview channel for SQL warehouses.

See Use semantic metadata in metric views and Upgrade considerations.

To use semantic metadata, your metric view must use YAML specification version 1.1 or higher and run on Databricks Runtime 17.2 or above. The corresponding Databricks SQL version is 2025.30, available in the Preview channel for SQL warehouses.

See Use semantic metadata in metric views and Upgrade your YAML to 1.1.

The email you provide becomes the GIT_AUTHOR_EMAIL and GIT_COMMITTER_EMAIL for commits, allowing Git providers to properly associate commits with your user account and display your profile information. If no email is specified, Databricks uses your Git username as the email address (legacy behavior).

See Git commit identity and email configuration.

This is a legitimate request from Databricks. It asks you to approve a new permission that allows Databricks to read your GitHub account email(s). Granting this permission will let Databricks retrieve and save your primary GitHub account email to your Linked Git credential in Databricks. In an upcoming feature, this will ensure that commits made from Databricks are properly linked to your GitHub identity.

If you don't accept the new permission, your Linked Git credential will still authenticate with GitHub. However, future commits from this credential will not be associated with your GitHub account identity

See Pipeline update timeline table schema.

See Develop and debug ETL pipelines with the Lakeflow Pipelines Editor.

For background, see Prepare for Connected App Usage Restrictions Change in the Salesforce documentation.

For steps to connect to Salesforce, see Salesforce

UTF8 based collations now support LIKE operator

You can now use LIKE with columns that have one of the following collations enabled: UTF8_Binary, UTF8_Binary_RTRIM, UTF8_LCASE, UTF8_LCASE_RTRIM. See Collation.

ST_ExteriorRing function is now supported

You can now use the ST_ExteriorRing function to extract the outer boundary of a polygon and return it as a linestring. See st_exteriorring function.

Declare multiple session or local variables in a single DECLARE statement

You can now declare multiple session or local variables of the same type and default value in a single DECLARE statement. See DECLARE VARIABLE and BEGIN END compound statement.

Support TEMPORARY keyword for metric view creation

You can now use the TEMPORARY keyword when creating a metric view. Temporary metric views are visible only in the session that created them and are dropped when the session ends. See CREATE VIEW.

DESCRIBE CONNECTION shows environment settings for JDBC connections

Databricks now includes user-defined environment settings in the DESCRIBE CONNECTION output for JDBC connections that support custom drivers and run in isolation. Other connection types remain unchanged.

SQL syntax for Delta read options in streaming queries

You can now specify Delta read options for SQL-based streaming queries using the WITH clause. For example:

SELECT * FROM STREAM tbl WITH (SKIPCHANGECOMMITS=true, STARTINGVERSION=X);

Correct results for split with empty regex and positive limit

Databricks now returns correct results when using split function with an empty regex and a positive limit. Previously, the function incorrectly truncated the remaining string instead of including it in the last element.

Fix url_decode and try_url_decode error handling in Photon

In Photon, try_url_decode() and url_decode() with failOnError = false now return NULL for invalid URL-encoded strings instead of failing the query.

See Enable the default publishing mode in a pipeline.

See Automatic authentication passthrough.

See Query route-optimized serving endpoints.

With Databricks One, business users can:

• View and interact with AI/BI dashboards to track KPIs and analyze metrics.
• Ask data questions in natural language using AI/BI Genie.
• Use custom-built Databricks Apps that combine analytics, AI, and workflows.

Workspace admins can enable Databricks One from the Previews page in the admin console.

See What is Databricks One?.

• (Pre-requisite) Enable file events for an external location
• File notification mode with and without file events enabled on external locations

After Delta Sharing for Default Storage – Expanded Access is enabled by default for all Databricks users, Delta Sharing on Lakehouse Federation will automatically be available in regions where default storage is supported.

See Default storage in Databricks and Add foreign schemas or tables to a share.

For information about Python custom data sources, see the following:

• Load data from a Python custom data source.
• Create a sink.
• PySpark custom data sources.

See Share data between SAP Business Data Cloud (BDC) and Databricks.

See Databricks and Microsoft Power Platform integration.

See Serverless GPU compute.

See Databricks Online Feature Stores.

For information, see MLflow system tables reference.

The Data Science Agent is custom-built for data science workflows and can build an entire notebook for tasks like EDA, forecasting, and machine learning from scratch. Using your prompt, it can plan a solution, retrieve relevant assets, run code, use cell outputs to improve results, fix errors automatically, and more.

See Use the Data Science Agent.

See Limitations.

See Enable the default publishing mode in a pipeline

See Limitations.

See Create and manage a database instance.

• Calling GET with filter params filter=displayName eq value_without_quotes results in a syntax error. To prevent this error, use quotation marks to wrap the value (for example, filter=displayName eq "value_with_quotes").

• Calling GET /api/2.0/accounts/{account_id}/scim/v2/Groups no longer returns members. Instead, iterate through get group details to get membership information. See get group details.

• Calling PATCH /api/2.0/accounts/{account_id}/scim/v2/Groups/{id} returns a 204 response instead of a 200 response.

These changes apply to new accounts and will be grandfathered into existing accounts. Current integrations will continue to work without disruption.

For information about using the cell execution minimap, see Navigate the Databricks notebook and file editor.

Workspace admins can now create and manage the base environments available in their workspace. They can also set a default base environment for all new serverless notebooks. This allows workspace users to quickly start working in a consistent, cached environment.

See Manage serverless workspace base environments.

See Supported source tables.

See Model Context Protocol (MCP) on Databricks.

See Enable the default publishing mode in a pipeline

See Governed tags.

See Databricks Runtime 17.2 and Databricks Runtime 17.2 for Machine Learning.

See Configure a federation policy.

See Data type mapping.

See Automatic liquid clustering, create_streaming_table, table, CREATE MATERIALIZED VIEW (pipelines), and CREATE STREAMING TABLE (pipelines).

See Update a serverless budget policy of a database instance, Create a synced table, and Custom tags.

• ap-northeast-2
• ap-south-1

See Features with limited regional availability

See Lakehouse Federation for Salesforce Data 360 File Sharing.

See Personalized autocomplete.

When you deploy a bundle with a database instance, the instance starts running immediately.

See database_catalog, database_instance, and synced_database_table.

To learn more about chatting with the Assitant, see Tour of the Assistant pane. To learn more about compute resources, see Compute.

For information about setting the run-as user, see Set the run-as user.

Recursive common table expressions (rCTE) are generally available

Recursive common table expressions (rCTEs) are generally available. Navigate hierarchical data using a self-referencing CTE with UNION ALL to follow the recursive relationship.

Support for schema and catalog level default collation

You can now set a default collation for schemas and catalogs. This allows you to define a collation that applies to all objects created within the schema or catalog, ensuring consistent collation behavior across your data.

Support for Spatial SQL expressions and GEOMETRY and GEOGRAPHY data types

You can now store geospatial data in built-in GEOMETRY and GEOGRAPHY columns for improved performance of spatial queries. This release adds more than 80 new spatial SQL expressions, including functions for importing, exporting, measuring, constructing, editing, validating, transforming, and determining topological relationships with spatial joins. See ST geospatial functions, GEOGRAPHY type, and GEOMETRY type.

Support for schema and catalog level default collation

You can now set a default collation for schemas and catalogs. This allows you to define a collation that applies to all objects created within the schema or catalog, ensuring consistent collation behavior across your data.

Better handling of JSON options with VARIANT

The from_json and to_json functions now correctly apply JSON options when working with top-level VARIANT schemas. This ensures consistent behavior with other supported data types.

Support for TIMESTAMP WITHOUT TIME ZONE syntax

You can now specify TIMESTAMP WITHOUT TIME ZONE instead of TIMESTAMP_NTZ. This change improves compatibility with the SQL Standard.

Resolved subquery correlation issue

Databricks no longer incorrectly correlates semantically equal aggregate expressions between a subquery and its outer query. Previously, this could lead to incorrect query results.

Error thrown for invalid CHECK constraints

Databricks now throws an AnalysisException if a CHECK constraint expression cannot be resolved during constraint validation.

Stricter rules for stream-stream joins in append mode

Databricks now disallows streaming queries in append mode that use a stream-stream join followed by window aggregation, unless watermarks are defined on both sides. Queries without proper watermarks can produce non-final results, violating append mode guarantees.

• Materialized views and streaming tables created after August 14, 2025 will have the warehouse timeout automatically applied.
• For materialized views and streaming tables created before August 14, 2025, run CREATE OR REFRESH to synchronize the timeout setting with the timeout configuration of the warehouse.
• All materialized views and streaming tables now have a default timeout of two days.

See New ETL pipeline.

See Configure AI Gateway on model serving endpoints for how to configure token-based rate limits.

See Use Databricks-hosted models for AI-powered features.

See Function calling on Databricks.

Admins can also add workspace-wide instructions, which take priority over user instructions.

Instructions apply across Assistant experiences like Inline Assistant, General Chat, Suggest Fix, and Edit mode. See Add custom instructions.

See Compute configuration reference.

This change affects SQL commands ([CREATE OR] REPLACE TABLE), DataFrame APIs (saveAsTable, replace, createOrReplace), and other similar update table operations.

See Manually apply row filters and column masks.

Users can request access to Unity Catalog objects that they discover. These requests are sent to configured destinations, such as emails, Slack or Microsoft Teams channels, or they can be redirected to an internal access management system.

You can also enable default email destinations so requests automatically go to the catalog or object owner’s email if no other destination is set. This ensures that access requests are delivered even when no destination is manually configured for an object.

See Manage access requests.

See Disable access to legacy features in new workspaces.

See Create and manage a database instance and Manage Databricks previews.

See Run jobs continuously.

See Create external Delta tables from external clients.

This release includes the following fixes and new features:

• The process name is now used as the default UserAgentEntry if the UserAgentEntry is not explicitly set.
• Added support for Databricks domains cloud.databricks.us and cloud.databricks.mil.
• Enhanced recognition and handling of timestamp_ntz columns across multiple data source functions including SQLGetTypeInfo, SQLColumns, and SQLColAttribute.
• Added CRL (Certificate Revocation Lists) cache support on Windows when UseSystemTruststore is enabled.
• Added VOID type column support, so that VOID columns are now correctly listed in SQLGetColumns.
• Enabled OAuth Token exchange for IDPs different from the host, which allows the exchange of OAuth access tokens (including BYOT) for Databricks in-house tokens.
• Added support for Windows Server 2025.
• Fixed a memory leak in the driver.

This release includes upgrades to several third-party libraries:

• OpenSSL upgraded from 3.0.15 to 3.0.16
• libcURL upgraded from 8.11.0 to 8.12.1
• Expat upgraded from 2.6.3 to 2.7.1

This release includes the following behavior changes:

• The connector no longer supports Databricks Runtime version 10.4 LTS.
• The default maximum catalog name length and maximum schema name length has been changed from 128 to 1024.
• Ubuntu 20.04 is no longer supported.

For complete configuration information, see the Databricks ODBC Driver Guide installed with the driver download package.

See Configure service principals on Databricks for Power BI.

For information about using Assistant on code, see Get coding help from Databricks Assistant.

See the Terraform documentation and changelog.

See Billable usage system table reference and Serve lakehouse data with synced tables (Lakebase Provisioned).

The new form includes the following changes:

• New definition dropdown menus allow you to configure rules without needing to reference the policy syntax.
• Max compute resources per user, max DBUs per hour, and cluster type settings have moved under the Advanced options section.
• Tagging definitions now have their own separate section.
• Policy permission settings have moved out of the policy form and are now set using the permissions modal in the policy overview page.

See Configure policy definitions using the new policy form.

See Add tables and schemas secured by ABAC policies to a share and Read ABAC-secured data and apply ABAC policies.

See Add streaming tables to a share, Add materialized views to a share, and Read shared streaming tables and materialized views.

See Enable Delta Sharing on a metastore and View providers.

• Add a split view to edit notebooks side by side. See Edit notebooks side by side.
• Pressing Cmd + F (Mac) or Ctrl + F (Windows) in a notebook now opens the native Databricks find-and-replace tool. This allows you to quickly search and replace text throughout your entire notebook, including content outside the current viewport. See Find and replace text.
• Quickly switch between tab groups based on authoring contexts using the , , and icons on the top left in the editor. See Switch between authoring contexts.

• us-west-2
• us-east-1
• us-east-2
• ap-northeast-1
• ap-northeast-2
• ap-south-1
• ap-southeast-1
• ap-southeast-2
• ca-central-1
• eu-central-1
• eu-west-1
• eu-west-2
• sa-east-1

See ai_parse_document function.

• cache_origin_statement_id: For query results fetched from cache, this field contains the statement ID of the query that originally inserted the result into the cache.
• query_parameters: A struct containing named and positional parameters used in parameterized queries.
• written_rows: The number of rows of persistent data written to cloud object storage.
• written_files: Number of files of persistent data written to cloud object storage.

See Query history system table reference.

For Public Preview, columns in the USING clause must be the full set of the table's partition columns.

See INSERT in the SQL language reference and Selectively overwrite data with Delta Lake.

See INSERT in the SQL language reference.

See Use Agent Bricks: Supervisor Agent to create a coordinated multi-agent system.

See Databricks Runtime 17.1 (EoS) and Databricks Runtime 17.1 for Machine Learning (EoS).

Gemma 3 12B model supports text inputs for the following Model Serving features:

• Foundation Model APIs pay-per-token.
• Foundation Model APIs provisioned throughput.
• AI Functions. Both real time inference and batch inference workloads are supported.

See SQL warehouse ACLs.

See Use the simple form to manage compute.

See Automated session restoration for serverless notebooks.

See How Git integration works with alerts.

See Configure ADBC or ODBC driver for Power BI.

• FedRAMP Moderate
• IRAP
• Canada Protected B

See Compliance security profile standards: Foundation Model APIs workloads for region availability of these standards.

See Add a Lakebase resource to a Databricks app.

See Resource limits.

See Set up Databricks Git folders.

This external lineage metadata feature is in Public Preview. See Bring your own data lineage.

See Use PDFs in Agent Bricks for Information Extraction and Custom LLM.

This function is available in Beta. See ai_parse_document function.

See Databricks Runtime 17.0 (EoS) and Databricks Runtime 17.0 for Machine Learning (EoS).

See Use Open ID Connect (OIDC) federation to enable authentication to Delta Sharing shares (open sharing).

See Enable the default publishing mode in a pipeline.

• Endpoint: Specify the overall rate limit for all traffic passing through the endpoint, regardless of individual or user group limits.
• User (Default): Specify the rate limit for all users of the endpoint that do not have user-specific or group-specific rate limits defined.
• Specific user: Specify the rate limit for a particular user of the endpoint.
• Service principal: Specify the rate limit for a particular service principal.
• User group: Specify the rate limit for a particular user group. This limit is shared across all members of the group.

See Configure AI Gateway using the UI.

• FedRAMP Moderate
• IRAP
• Canada Protected B

See Compliance security profile standards: CPU and GPU workloads for region availability of these standards.

• Customizable dashboard theme: Authors can now customize the dashboard theme by setting custom font, background, and widget colors. See Dashboard settings.

• If you already use a Databricks-hosted model for Assistant, there is no change.
• If you turn off Partner-powered AI features, AI documentation now stays available and uses a Databricks-hosted model.

For more information, see:

• Partner-powered AI features
• Add AI-generated comments to Unity Catalog objects

Using ABAC, you can define scalable policies once and apply them across large sets of data assets. Policies inherit across the object hierarchy and can include row-level filters or column masking logic. This simplifies governance, supports centralized policy management, and improves security posture. See Unity Catalog attribute-based access control (ABAC).

See Lakebase Postgres.

The Beta release supports API-based pipeline creation. UI-based pipeline creation is not yet supported.

AI Gateway brings governance, monitoring, and production readiness to model serving endpoints using the following features:

• Permission and rate limiting to control who has access and how much access.
• Payload logging to monitor and audit data being sent to model APIs using inference tables.
• Usage tracking to monitor operational usage on endpoints and associated costs using system tables.
• Traffic routing to load balance traffic across multiple models.
• Fallbacks for external models to minimize production outages during and after deployment.

For information about the SQL AUTO CDC API, see:

• AUTO CDC INTO (pipelines)

For information about the Python create_auto_cdc_flow APIs, see

• create_auto_cdc_flow
• create_auto_cdc_from_snapshot_flow

• Lower latency: Dashboards, ETL jobs, and mixed workloads now run faster, with up to 25% improvement. The upgrade is automatically applied to serverless SQL warehouses with no additional cost or configuration.
• Predictive Query Execution (PQE): PQE monitors tasks in real time and dynamically adjusts query execution to help avoid skew, spills, and unnecessary work.
• Photon vectorized shuffle: Keeps data in compact columnar format, sorts it within the CPU's high-speed cache, and processes multiple values simultaneously using vectorized instructions. This improves throughput for CPU-bound workloads such as large joins and wide aggregation.

MLflow 3.0 on Databricks delivers state-of-the-art experiment tracking, observability, and performance evaluation for machine learning models, generative AI applications, and agents on the Databricks Lakehouse. See Get started with MLflow 3 for models.

Deployment jobs allow you to automate tasks like evaluation, approval, and deployment whenever a new model version is created, integrating seamlessly with Unity Catalog models and Lakeflow Jobs. See MLflow 3 deployment jobs.

When the Performance optimized setting is enabled, your workload is optimized for faster startup and execution time. When disabled, the serverless workload runs on standard performance mode, which is optimized for cost and has a slightly higher launch latency.

For more information, see Select a performance mode and Select a performance mode.

• Managed MCP servers: Use Databricks-hosted servers for easy, no-maintenance access to Unity Catalog data and tools.
• Custom MCP servers: Host your own MCP server or third-party server as a Databricks app.

See Model Context Protocol (MCP) on Databricks.

A new system table allows you to track the shared materialized data history. See Delta Sharing materialization history system table reference.

Account admins can now configure the time-to-live (TTL) of data materialization. See Configure TTL of data materialization.

With network policies you can:

• Configure outbound access for serverless workloads.
• Allowlist specific domains and storage accounts for restricted mode.
• Enable dry-run mode to monitor policy impact before enforcement.
• View and analyze denial logs in Unity Catalog for auditing and troubleshooting.

See Manage network policies for serverless egress control

Tag policies are managed at the account level and apply across all workspaces. For more information, see Governed tags

See Serverless GPU compute.

• Consumer access enables limited workspace UI access, querying SQL warehouses using BI tools, and viewing dashboards with embedded or viewer credentials.

• Useful for business users who need access to shared content and dashboards but not to author or manage workspace objects.

• This entitlement is more restrictive than workspace access or Databricks SQL access. To assign it independently, remove broader entitlements from the users group and configure them per user or group.

See Manage entitlements.

For the full list of supported regions, see Databricks clouds and regions.

Compared to query federation, file federation is ideal for federating a large amount of data. It offers improved performance for reading files from multiple data sources and better pushdown capabilities.

For more information, see Lakehouse Federation for Salesforce Data 360 File Sharing.

See Billable usage system table reference.

See Connect to external HTTP services.

The Auto Loader cloudFiles.useIncrementalListing option is deprecated. Although this note discusses a change to the options's default value and how to continue using it after this change, Databricks recommends against using this option in favor of file notification mode with file events.

In an upcoming Databricks Runtime release, the value of the deprecated Auto Loader cloudFiles.useIncrementalListing option will, by default, be set to false. Setting this value to false causes Auto Loader to perform a full directory listing each time it's run. Currently, the default value of the cloudFiles.useIncrementalListing option is auto, instructing Auto Loader to make a best-effort attempt at detecting if an incremental listing can be used with a directory.

To continue using the incremental listing feature, set the cloudFiles.useIncrementalListing option to auto. When you set this value to auto, Auto Loader makes a best-effort attempt to do a full listing once every seven incremental listings, which matches the behavior of this option before this change.

To learn more about Auto Loader directory listing, see Auto Loader streams with directory listing mode.

If the audit log contains a sourceIpAddress of 0.0.0.0, Databricks might stop logging it.

The in-product experience, which is available if your organization has a Databricks Support contract, integrates with Databricks Assistant to help address your issues quickly without having to submit a ticket.

To access the in-product experience, click your user icon in the top bar of the workspace, and then click Contact Support or type “I need help” into the assistant.

The Contact support modal opens.

If the in-product experience is down, send requests for support with detailed information about your issue to help@databricks.com. For more information, see Get help.

• Fix for global filters on full-screen widgets: An issue that prevented full-screen widgets from displaying data when used with global filters has been resolved.

• Drop-down selection fix: Fixed an issue where selection options in a drop-down list appeared out of order.

• Global filters panel: Dashboard authors can now add filters to a global filters panel, which applies across all dashboard pages.

• Relative date and time preview improvement: Previews for relative date and time controls are now hidden to avoid confusion caused by time zone differences.

• Dashboard PDF snapshots improvement: Dashboard PDF snapshots now wrap the content of the dashboard and no longer include white space.

• Constant reference line annotations: Horizontal and vertical constants reference line annotations for quantitative axes in cartesian chart types, such as area, bar, line, scatter, heatmap, and histogram charts.

• Improved query result display in Genie: Query results now show more quickly. It now displays Running query until the query result is ready and Still thinking if additional work is required.

• UI polling update in Genie: The UI now starts polling for result data sooner rather than waiting until after the visualization and sample questions are generated.

• Fixed missing Trusted badge in Genie: The Trusted badge now appears on certified answers and parameterized queries.

• SQL function de-emphasis in Genie: The option to add SQL functions has been de-emphasized, making adding example SQL the default action.

• Improved result delivery timing in Genie: Descriptions are now generated after the SQL is run, thereby reducing the time it takes to get results.

• Fixed empty visualizations issue in Genie: Fixed an issue where empty visualizations were occasionally rendering in Genie.

• Improved instruction processing in Genie: Genie's chain-of-thought reasoning has been refined to prioritize and adhere to the most relevant instructions based on the user prompt.