Databricks on AWS GovCloud release notes 2025
The following platform features, improvements, and fixes were released on Databricks on AWS GovCloud in 2025.
April 2025
The following features and updates were released on Databricks on AWS GovCloud in April 2025.
Share streaming tables and materialized views using Delta Sharing (Public Preview)
April 23, 2025
You can now use Delta Sharing to share streaming tables and materialized views.
See Create and manage shares for Delta Sharing and Read shared streaming tables and materialized views.
Strict enforcement of row-level security and column masking policies in Delta Sharing
April 21, 2025
Delta Sharing now consistently enforces row-level security and column masking policies applied to tables a shared data asset is dependent on, whether those policies were applied before or after the data asset was shared. Recipients may experience differences in query behavior when accessing shared data that depends on tables with row-level security or column masking policies. This ensures that data access aligns with the provider’s intended security controls at all times.
See Filter sensitive table data using row filters and column masks.
Run a subset of tasks within a job
April 21, 2025
You can now run a subset of the tasks when manually triggering a job. See Run a job with different settings.
Python type error highlighting
April 14, 2025
Python code in notebooks and file editors can highlight type errors for non-existent attributes, missing arguments, and mismatched arguments. See Python type error highlighting.
Reference SQL output in downstream tasks of a job
April 14, 2025
You can now use dynamic values to reference the output of a SQL task in downstream tasks in the same job. For each
tasks can iterate over the rows of data in the output.
See What is a dynamic value reference?.
Batch Unity Catalog Python UDFs (Public Preview)
April 14, 2025
Unity Catalog Batch Python UDFs extend the capabilities of Unity Catalog UDFs by allowing you to write Python code to operate on batches of data, significantly improving efficiency by reducing the overhead associated with row-by-row UDFs. Batch Python UDFs support service credentials to access external cloud services. See Batch Python User-defined functions (UDFs) in Unity Catalog.
Access UDF context information using TaskContext
April 14, 2025
The TaskContext PySpark API now allows you to retrieve context information—such as user identity and cluster tags—while running Batch Unity Catalog Python UDFs or PySpark UDFs. This feature lets you pass user-specific details, like identity, to authenticate external services within UDFs. See Get task context in a UDF.
Databricks multi-factor authentication (MFA) is now available (Public Preview)
April 1, 2025
Account admins can now enable multi-factor authentication (MFA) directly in Databricks, allowing them to either recommend or require MFA for users at login.
This feature is available only for accounts that do not use single sign-on (SSO). If your account uses SSO, configure MFA through your organization’s identity provider.
For more information on Databricks MFA, see Configure multi-factor authentication.
The BROWSE
privilege is GA
April 1, 2025
The BROWSE
privilege is now generally available. The BROWSE
privilege allows you to grant users, service principals, and account groups permission to view a Unity Catalog object’s metadata. This enables users to discover data without having read access to the data. A user can view an object’s metadata using Catalog Explorer, the schema browser, search results, the lineage graph, information_schema
, and the REST API.
See BROWSE.