DLT release 2023.30

July 31 - August 4, 2023

These features and improvements were released with the 2023.30 release of DLT.

Databricks Runtime versions used by this release

Channel:

Breaking change: Pipeline maintenance clusters now inherit cluster configuration settings you define using the default cluster label. Previously, settings required for both the updates and maintenance clusters needed to be manually configured for both clusters in pipeline settings. Because settings are now automatically inherited by the maintenance cluster, this change improves the reliability of maintenance processing. Use the updates label for settings that should not be applied to maintenance clusters. See Configure classic compute for Lakeflow Declarative Pipelines.

This release includes performance improvements that reduce the time to set up tables when DLT runs an update. These performance improvements reduce the total time to run pipeline updates.

A new tabbed dataset details panel provides a cleaner user interface when viewing details about a dataset in your pipeline and makes it easier to find specific information about your datasets.