Amazon
Web Services
Microsoft Azure
Google Cloud PlatformMay 2022
These features and Databricks platform improvements were released in May 2022.
Note
Releases are staged. Your Databricks account may not be updated until a week or more after the initial release date.
Copy and paste notebook cells between tabs and windows
May 31 - June 6, 2022: Version 3.73
You can now copy and paste cells between notebooks in different browser tabs or windows. See Cut, copy, and paste cells.
Additional data type support for Databricks Feature Store automatic feature lookup
May 31 - June 6, 2022: Version 3.73
Databricks Feature Store now supports additional data types for automatic feature lookup: DecimalType, ArrayType, MapType. See Automatic feature lookup with Databricks Model Serving.
Databricks Runtime 11.0 (Beta)
May 24, 2022
Databricks Runtime 11.0, 11.0 Photon, and 11.0 ML are now available as Beta releases.
See the full release notes at Databricks Runtime 11.0 (EoS) and Databricks Runtime 11.0 for Machine Learning (EoS).
Improved workspace search (Public Preview)
May 16-23, 2022: Version 3.72
You can now search for notebooks, libraries, folders, files, and repos by name. You can also search for content within a notebook and see a preview of the matching content. Search results can be filtered by type. See Search for workspace objects.
Explore SQL cell results in Python notebooks natively using Python
May 16-23, 2022: Version 3.72
In Python notebooks, the results of SQL cells are now available as a PySpark DataFrame _sqldf for easy exploration in Python. See Explore SQL cell results.
Note
This feature was delayed and will be rolled out over Databricks platform releases 3.74 through 3.76.
Databricks Repos: Support for more files in a repo
May 16-23, 2022: Version 3.72
Databricks increased the number of files supported in a repo:
The notebook limit: 5,000.
The limit for the total of all files including notebooks: 10,000.
Previously, you were limited to 5,000 total files in a repo.
For details, see File and repo limits.
Databricks Repos: Fix to issue with MLflow experiment data loss
May 16-23, 2022: Version 3.72
Previously, in some situations, switching branches in Databricks Repos could cause the MLflow experiment associated with a notebook to be deleted. This issue has been fixed for most scenarios.
Upgrade wizard makes it easier to copy databases and multiple tables to Unity Catalog (Public Preview)
May 13, 2022
If you use Unity Catalog for data governance, you can now use an upgrade wizard to copy complete schemas (databases) and multiple tables from your default Hive metastore to the Unity Catalog metastore. The wizard also streamlines permission assignment for the upgraded schemas and tables. Only upgrade of external tables is supported with this release. See Upgrade a schema or multiple tables from the Hive metastore to Unity Catalog external tables using the upgrade wizard.
Power BI Desktop system-wide HTTP proxy support
May 11, 2022
The Power BI connector now supports automatic detection of the system HTTP proxy configuration in Power BI Desktop. See Automated HTTP proxy detection.
Streamline billing and account management by signing up for Databricks using AWS Marketplace
May 10, 2022
You can now use AWS Marketplace to sign up for Databricks. AWS users with the Purchaser role can manage your subscription. Charges appear on the AWS Billing & Cloud Management dashboard alongside your other AWS charges. After the free trial period, you are billed only for the resources you use. For more information, see Sign up through AWS Marketplace.
Databricks Runtime 10.5 and 10.5 ML are GA; 10.5 Photon is Public Preview
May 4, 2022
Databricks Runtime 10.5 and Databricks Runtime 10.5 ML are now generally available. Databricks Runtime 10.5 Photon is in Public Preview.
See Databricks Runtime 10.5 (EoS) and Databricks Runtime 10.5 for Machine Learning (EoS).
Authenticate to the account console using SAML 2.0 (Public Preview)
May 3, 2022
Databricks now supports SSO authentication to the account console using SAML 2.0 as an alternative to OIDC. See Configure SSO in Databricks. This feature is available as a Public Preview.
Databricks JDBC driver 2.6.25
May 3, 2022
We have released the Databricks JDBC driver 2.6.25 (download). The driver is also available as an Apache Maven artifact. This release optimizes the default configuration used to connect to Databricks. See also Databricks ODBC Driver Downloads.