Amazon
Web Services
Microsoft Azure
Google Cloud PlatformDelta Live Tables release 2023.16
April 24 - 28, 2023
These features and improvements were released with the 2023.16 release of Delta Live Tables.
Databricks Runtime versions used by this release
Channel:
CURRENT (default): Databricks Runtime 11.3.10
PREVIEW: Databricks Runtime 12.2.3
New features and improvements in this release
Delta Live Tables support for Unity Catalog is in Public Preview. You can use Unity Catalog with your Delta Live Tables pipelines to:
Define a catalog in Unity Catalog where your pipeline will persist tables.
Read data from Unity Catalog tables.
See Use Unity Catalog with your Delta Live Tables pipelines.
By default, streaming tables require append-only sources. This release introduces the
skipChangeCommitsflag that can be set on a target streaming table to ignore changes in a source streaming table when the source table requires updates or deletes. See Configure a streaming table to ignore changes in a source streaming table.
With this release, the limit for concurrent updates in a workspace is increased to 100. The previous concurrent updates limit was 20.
When you run a Delta Live Tables pipeline from a pipeline notebook, you can now view the event log in the notebook sidebar. See Develop and debug Delta Live Tables pipelines in notebooks.