Databricks Runtime 7.3 LTS migration guide

This guide helps you migrate your Databricks workloads to Databricks Runtime 7.3 LTS, powered by Apache Spark 3.0.

To migrate workloads to Databricks Runtime 7.3 LTS, see the Apache Spark migration guidance.

Databricks Runtime 10.4 LTS is the latest supported LTS version. To migrate workloads from Databricks Runtime 7.3 LTS to Databricks Runtime 10.4 LTS, Databricks recommends that you migrate your workloads in the following order:

  1. Migrate to Databricks Runtime 9.1 LTS. See the Databricks Runtime 9.1 LTS migration guide.

  2. Migrate from Databricks Runtime 9.1 LTS to Databricks Runtime 10.4 LTS. See the Databricks Runtime 10.x migration guide.

Apache Spark migration guidance

Databricks Runtime 7.3 LTS is powered by Apache Spark 3.0.1. For Spark-specific migration information, see the Apache Spark 3.0.1 Migration Guide. For reference, the following Databricks Runtime versions through Databricks Runtime 7.3 LTS are powered by these Apache Spark versions:

Databricks Runtime version

Apache Spark version

7.3 LTS

3.0.1

7.0 - 7.2

3.0.0

6.4 Extended Support and 6.4 - 6.6

2.4.5

6.1 - 6.3

2.4.4

5.5 LTS and 5.5 Extended Support and 6.0

2.4.3

5.0 - 5.4

2.4

4.0 - 4.3

2.3

3.0 - 3.5 LTS

2.2

Light 2.4 Extended Support and Light 2.4

2.4.0+

For migration information for Spark 2.4.x to 3.0, see the following:

For migration information for Spark 2.4.4 to 2.4.5, see the following:

For migration information for Spark 2.4.3 to 2.4.4, see the following:

For migration information for Spark 2.3 to 2.4, see the following:

For migration information for Spark 2.2 to 2.3, see the following:

Databricks Runtime system environment properties, features, and libraries

For information about system environment properties as well as new, changed, and deprecated features and libraries in Databricks Runtime releases through Databricks Runtime 7.3 LTS, see the following:

Post-release maintenance updates are listed in Databricks runtime maintenance updates.

Additional migration guidance

For additional guidance about migrating workloads from Databricks Runtime 6.x to Databricks Runtime 7.x, see the Databricks Runtime 7.x migration guide.