Databricks Runtime 7.3 LTS migration guide

This guide helps you migrate your Databricks workloads to Databricks Runtime 7.3 LTS, powered by Apache Spark 3.0.

To migrate workloads to Databricks Runtime 7.3 LTS, see the Apache Spark migration guidance.

Databricks Runtime 11.3 LTS is the latest supported LTS version. To migrate workloads from Databricks Runtime 7.3 LTS to Databricks Runtime 11.3 LTS, Databricks recommends that you migrate your workloads in the following order:

1. Migrate to Databricks Runtime 10.4 LTS. See the Databricks Runtime 10.x migration guide.

2. Migrate from Databricks Runtime 10.4 LTS to Databricks Runtime 11.3 LTS. See the Databricks Runtime 11.x migration guide.

Apache Spark migration guidance

Databricks Runtime 7.3 LTS is powered by Apache Spark 3.0.1. For Spark-specific migration information, see the Apache Spark 3.0.1 Migration Guide. For reference, the following Databricks Runtime versions through Databricks Runtime 7.3 LTS are powered by these Apache Spark versions:

Databricks Runtime version	Apache Spark version
7.3 LTS	3.0.1
7.0 - 7.2	3.0.0
6.4 Extended Support and 6.4 - 6.6	2.4.5
6.1 - 6.3	2.4.4
5.5 LTS and 5.5 Extended Support and 6.0	2.4.3
5.0 - 5.4	2.4
4.0 - 4.3	2.3
3.0 - 3.5 LTS	2.2
Light 2.4 Extended Support and Light 2.4	2.4.0+

For migration information for Spark 2.4.x to 3.0, see the following:

• Upgrading from Core 2.4 to 3.0

• Migration Guide: SQL, Datasets and DataFrame

• Upgrading from Structured Streaming 2.4 to 3.0

• Upgrading from MLib 2.4 to 3.0

• Upgrading from PySpark 2.4 to 3.0

• Upgrading from SparkR 2.4 to 3.0

For migration information for Spark 2.4.4 to 2.4.5, see the following:

• Upgrading from Spark SQL 2.4.4 to 2.4.5

For migration information for Spark 2.4.3 to 2.4.4, see the following:

• Upgrading from Spark SQL 2.4.3 to 2.4.4

For migration information for Spark 2.3 to 2.4, see the following:

• Upgrading from Spark SQL 2.3 to 2.4

• Upgrading from PySpark 2.3 to 2.4

• Upgrading from SparkR 2.3 to 2.4

For migration information for Spark 2.2 to 2.3, see the following:

• Upgrading from Spark SQL 2.2 to 2.3

• Upgrading from PySpark 2.2 to 2.3

• Upgrading from SparkR 2.2 to 2.3

Databricks Runtime system environment properties, features, and libraries

For information about system environment properties as well as new, changed, and deprecated features and libraries in Databricks Runtime releases through Databricks Runtime 7.3 LTS, see the following:

• Databricks Runtime 7.3 LTS for Machine Learning

• Databricks Runtime 7.3 LTS

• Databricks Runtime 7.2 for ML (Unsupported)

• Databricks Runtime 7.2 (Unsupported)

• Databricks Runtime 7.1 for ML (Unsupported)

• Databricks Runtime 7.1 (Unsupported)

• Databricks Runtime 7.0 ML (Unsupported)

• Databricks Runtime 7.0 (Unsupported)

• Databricks Runtime 6.6 ML (Unsupported)

• Databricks Runtime 6.6 (Unsupported)

• Databricks Runtime 6.5 for ML (Unsupported)

• Databricks Runtime 6.5 (Unsupported)

• Databricks Runtime 6.4 Extended Support (Unsupported)

• Databricks Runtime 6.4 for ML (Unsupported)

• Databricks Runtime 6.4 (Unsupported)

• Databricks Runtime 6.3 for ML (Unsupported)

• Databricks Runtime 6.3 (Unsupported)

• Databricks Runtime 6.2 for ML (Unsupported)

• Databricks Runtime 6.2 (Unsupported)

• Databricks Runtime 6.1 for ML (Unsupported)

• Databricks Runtime 6.1 (Unsupported)

• Databricks Runtime 6.0 for ML (Unsupported)

• Databricks Runtime 6.0 (Unsupported)

• Databricks Runtime 5.5 ML Extended Support (Unsupported)

• Databricks Runtime 5.5 Extended Support (Unsupported)

• Databricks Runtime 5.5 LTS for ML (Unsupported)

• Databricks Runtime 5.5 LTS (Unsupported)

• Databricks Runtime 5.4 for ML (Unsupported)

• Databricks Runtime 5.4 (Unsupported)

• Databricks Runtime 5.3 ML (Unsupported)

• Databricks Runtime 5.3 (Unsupported)

• Databricks Runtime 5.2 (Unsupported)

• Databricks Runtime 5.1 (Unsupported)

• Databricks Runtime 5.0 (Unsupported)

• Databricks Runtime 4.3 (Unsupported)

• Databricks Runtime 4.2 (Unsupported)

• Databricks Runtime 4.1 (Unsupported)

• Databricks Runtime 4.0 (Unsupported)

• Databricks Runtime 3.5 LTS (Unsupported)

• Databricks Runtime 3.4 (Unsupported)

• Databricks Light 2.4 Extended Support

• Databricks Light 2.4 (Unsupported)

Post-release maintenance updates are listed in Databricks runtime maintenance updates.

Additional migration guidance

For additional guidance about migrating workloads from Databricks Runtime 6.x to Databricks Runtime 7.x, see the Databricks Runtime 7.x migration guide.