December 2021
These features and Databricks platform improvements were released in December 2021.
Note
Releases are staged. Your Databricks account may not be updated until a week or more after the initial release date.
Databricks Runtime 6.4 Extended Support series end-of-support date extended
December 31, 2021
Support for the Databricks Runtime 6.4 Extended Support series has been extended to June 30, 2022. A previous announcement stated that support would end on December 31, 2021. See All supported Databricks Runtime releases.
Databricks Runtime 5.5 Extended Support series reaches end of support
December 31, 2021
Support for the Databricks Runtime 5.5 Extended Support series ended on December 31. See Databricks support lifecycles.
Databricks JDBC driver 2.6.21
December 24, 2021
We have released version 2.6.21 of the Databricks JDBC driver (download). This release includes an upgrade of the Log4j library to version 2.17.0.
Databricks Connector for Tableau 2021.4
December 23, 2021
We have released a new version of the Databricks connector in Tableau 2021.4. This release adds support for navigating a three-level namespace in the Unity Catalog.
Databricks Runtime 10.2 and 10.2 ML are GA; 10.2 Photon is Public Preview
December 22, 2021
Databricks Runtime 10.2 and Databricks Runtime 10.2 ML are now generally available. Databricks Runtime 10.2 Photon is in Public Preview.
See Databricks Runtime 10.2 (EoS) and Databricks Runtime 10.2 for ML (EoS).
Workspaces in the ap-southeast-1
region now support AWS PrivateLink
December 17, 2021
Workspaces in the ap-southeast-1
region now support AWS PrivateLink for both front-end and back-end connections.
Updated Markdown parser
December 13, 2021 - January 6, 2022: Version 3.61
The Markdown parser used in Databricks notebooks has been updated. The new version is faster when rendering. Some behavior has changed. The new behavior is closer to the commonmark spec.
The primary changes are:
You must now put a space between the hashtags and the text of a heading.
When you mix HTML and Markdown code in a cell, you must put a newline after each HTML start tag.
For example, the Markdown code to produce this result:
is as shown:
%md
## Heading
<del>
*example text*
</del>
User interface improvements for Delta Live Tables
December 13, 2021 - January 6, 2022: Version 3.61
This release includes the following enhancements to the Delta Live Tables UI:
When you create a pipeline, you can directly edit the JSON specification in the Create Pipeline dialog by clicking the JSON button.
You can view tooltips for data quality metrics by hovering over data quality values in the processing graph view for your pipeline.
Databricks Runtime 8.3 series support extended
December 8, 2021
Support for Databricks Runtime 8.3 and Databricks Runtime 8.3 for Machine Learning has been extended from December 8, 2021 to January 20, 2022. See All supported Databricks Runtime releases.
Databricks Runtime 10.2 (Beta)
December 6, 2021
Databricks Runtime 10.2, 10.2 Photon, and 10.2 ML are now available as Beta releases.
See Databricks Runtime 10.2 (EoS) and Databricks Runtime 10.2 for ML (EoS).
Revert of recent breaking change that removed escaping and quotes from $ in environment variable values for cluster creation
December 3, 2021
The breaking change to environment variable behavior that was introduced in some workspaces last month will be reverted on December 3, 2021 from 01:00-03:00 UTC.
serverless SQL warehouses are available in region eu-west-1
December 1, 2021
Serverless SQL endpoints are now available in region eu-west-1
. For the list of supported regions, see Databricks clouds and regions.