Delta Live Tables release 2024.49

December 9 - 12, 2024

These features and improvements were released with the 2024.49 release of Delta Live Tables.

Databricks Runtime versions used by this release

Channel:

  • CURRENT (default): Databricks Runtime 15.4

  • PREVIEW: Databricks Runtime 15.4

Note

Because Delta Live Tables channel releases follow a rolling upgrade process, channel upgrades are deployed to different regions at different times. Your release, including Databricks Runtime versions, might not be updated until a week or more after the initial release date. To find the Databricks Runtime version for a pipeline, see Runtime information.

New features and improvements

  • You can now configure single node compute for your Unity Catalog-enabled pipelines. When you configure single node compute, the minimum number of nodes required to run your pipeline is reduced from two nodes to one node by running Spark jobs on the same node as the Spark driver. To configure a single node cluster, set min_workers and max_workers to 0. See Create a single node cluster.

  • This release includes the following changes when a materialized view or streaming table is deleted. Deletion of a materialized view or streaming table can occur when you remove the definition of the materialized view or streaming table from a pipeline or delete it in the Catalog Explorer:

    • The time to recover the materialized view or streaming table definition is reduced to seven days. This is the same time period as Unity Catalog-managed tables. After the seven day period, declaring a materialized view or streaming table with the same name creates a new materialized view or streaming table.

    • The underlying data in the deleted materialized view or streaming table is removed after 30 days.

Bug fixes

  • This release fixes a bug that causes an error when trying to create a materialized view with a hyphen in the name, even when enclosing the name in backticks. For example, without this fix, the following statement generates an error: CREATE MATERIALIZED VIEW my_catalog.my_schema.`mv-hyphen` AS... .