Migrate Apache Spark to 3.x

Important

This documentation has been retired and might not be updated. The products, services, or technologies mentioned in this content are no longer supported. See Databricks Runtime release notes versions and compatibility.

New Databricks Runtime versions include updated versions of Apache Spark. Apache Spark 3.0 was released in June 2020. The reference articles below are maintained in this archive for users who are upgrading to Apache Spark 3.x.