Use CI/CD

To manage the lifecycle of Databricks assets and data, you can use continuous integration and continuous delivery (CI/CD) and data pipeline tools.

Area

Use these tools when you want to…

Continuous integration and delivery on Databricks using GitHub Actions

Build a CI/CD workflow on GitHub that uses GitHub Actions developed for Databricks.

Continuous integration and delivery on Databricks using Jenkins

Develop a CI/CD pipeline for Databricks that uses Jenkins.

Orchestrate Databricks jobs with Apache Airflow

Manage and schedule a data pipeline that uses Apache Airflow.

Service principals for CI/CD

Use service principals, instead of users, with CI/CD systems.