January 2023

These features and Databricks platform improvements were released in January 2023.

Note

Releases are staged. Your Databricks account may not be updated until a week or more after the initial release date.

Authenticate to Power BI and Tableau using OAuth

January 31, 2023

You can now use OAuth to authenticate to Power BI and Tableau. For more information, see Databricks sign-on from partner solutions.

Audit logs include entries for OAuth SSO authentication to the account console (Public Preview)

January 31, 2023

Audit logs now include entries for OAuth SSO authentication to the account console. See Oauth SSO events. The new entries are available as a Public Preview.

Account SCIM is now GA

January 31, 2023

The Account SCIM API is now generally available.

Account SCIM lets you use an identity provider (IdP) to create users in a Databricks account, give users the proper level of access, and remove access (deprovision users) when they leave your organization or no longer need access to Databricks.

You can use a SCIM provisioning connector in your IdP or invoke the SCIM APIs to manage provisioning. For more information, see Sync users and groups from your identity provider.

Easier creation and editing of Databricks jobs in the UI

January 30, 2023

The Databricks Jobs user interface now shows a view of your entire job when you add or make changes to job tasks. This unified view simplifies job creation and editing by allowing you to see the full details of your job as you make changes. See Schedule and orchestrate workflows.

Improvements to the Databricks Jobs UI when viewing job runs

January 30, 2023

The Databricks Jobs user interface now shows the job runs matrix and the job runs list in a single panel, improving your visibility into the status and details of your job runs. Previously, viewing the runs matrix or the runs list required switching between the two views. See View runs for a job.

REST API Reference is now available for browsing API documentation

January 27, 2023

Try the new Databricks REST API Reference documentation experience in beta. The API Reference includes the latest versions of the Databricks REST API documentation.

The existing REST API documentation remains available as we gather feedback and develop this new experience. To send us your feedback on this beta experience, click Send feedback link in the upper-left corner of the page.

New account console home screen provides better account management experience

January 26, 2023

Admins can use the new account console home screen to better navigate between Databricks products.

Databricks Terraform provider updated to version 1.9.1

January 25, 2023

Version 1.9.1 adds max_clusters_per_user to databricks_cluster_policy, support for cluster_mount_infos in databricks_cluster, a parent attribute to databricks_sql_query and databricks_sql_dashboard, and more. For more details, see the changelog for version 1.9.1.

Account users can update email preferences in the account console

January 23, 2023

You can now update instructional product and feature email preferences in your Databricks account console. For more information, see Manage email preferences.

Region support consolidated onto one page

January 20, 2023

A new supported regions article consolidates all information about supported regions, including:

Region-specific feature support
IP addresses, domains, and endpoints for allow lists and custom network configurations

You can also switch between the AWS, Azure, and Google Cloud version of this article using the documentation site’s cloud switcher.

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are GA

January 19, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now generally available.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Cluster policies now support limiting the max number of clusters per user

January 18, 2023

You can now use cluster policies to restrict the number of clusters a user can create. For more information, see restrict the number of clusters per user.

Databricks Terraform provider updated to version 1.9.0

January 17, 2023

Version 1.9.0 adds a new databricks_mws_credentials data source, includes fixes to the databricks_sql_endpoint and databricks_sql_permissions resources, and more. For more details, see the changelog for version 1.9.0.

Partner Connect supports connecting to Privacera

January 12-19, 2023

You can now easily create a connection between Privacera and your Databricks workspace using Partner Connect. For more information, see Connect to Privacera using Partner Connect.

Databricks Terraform provider updated to version 1.8.0

January 10, 2023

Version 1.8.0 includes new resources such as databricks_instance_pool, databricks_provider for Delta Sharing, and databricks_permission_assignment. Several existing resources are improved. For more details, see the changelog for version 1.8.0.

Databricks Runtime 12.1 (Beta)

January 9, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now available as Beta releases.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Partner Connect supports Sigma

January 9-17, 2022

You can now easily create a connection between Sigma and your Databricks workspace using Partner Connect. For more information, see Connect to Sigma using Partner Connect.

New left and right sidebars in Databricks notebooks

January 5-12, 2023

We have added left and right sidebars to the Databricks notebook. You can now find the notebook’s table of contents in the left-hand sidebar, and you can find comments, MLflow experiments, and the notebook version history in the right-hand sidebar.