What is Genie Migrate?
Genie Migrate is the Databricks tool for migrating workloads from existing data warehouses and extract, transform, and load (ETL) tools to Databricks. Built on Genie Code, the Databricks AI coding agent, it converts SQL and ETL code from other platforms into Databricks SQL queries or Databricks notebooks that your team can review and run.
You manage each migration in a migration project in your workspace. Genie Migrate helps you assess your source system, converts related files together, checks and corrects its output, and shows the original and converted code side by side for your team to approve.
Stages of a Genie Migrate migration
A migration from another data platform has three stages: assessment, conversion, and data migration. Genie Migrate covers the assessment and conversion stages. To move the data itself, see Lakeflow Connect connector concepts.
-
- Create and analyze a project
- Assessment stage. Create a migration project, add your source files, analyze code complexity and the dependencies between files, and plan the migration in groups.
-
- Convert code
- Conversion stage. Convert SQL to Databricks SQL queries or Databricks notebooks, and review and accept the converted code.
What is a migration project?
A migration project is where you manage a migration in your workspace. It tracks the state of each file and gives you a single place to analyze, convert, and review your code. When you create a project, you choose:
- Source dialect: The SQL dialect of your existing code, such as T-SQL or Teradata, or Informatica for PowerCenter exports.
- Target framework: The format of the converted code. See Supported source dialects and target frameworks.
- Destination folder: The workspace folder where Genie Migrate writes the converted files.
To create a project, see Create a migration project.
Requirements for Genie Migrate
- Your existing SQL or XML files must be accessible in your workspace, either uploaded as workspace files or opened in the editor.
- Your workspace must meet the Genie Code requirements. See Genie Code.
- To use the Notebooks target framework, project analysis and lineage, or Informatica PowerCenter conversion, which are in Beta, a workspace admin must turn on Migration Projects Experimental Features from the Previews page. See Manage Databricks previews.