Skip to main content

Manage visual data prep files in Lakeflow Designer

Lakeflow Designer stores each visual data prep as a workspace file named <file_name>.designer.ipynb. You can create these files, export and import them to move them between workspaces, rename or delete them, and compare versions in a visual diff on the canvas. To version a visual data prep file with Git and take it to production, see Move a visual data prep file to production.

Create a visual data prep file​

To create a new visual data prep, click Plus icon. New in the sidebar and select Visual data prep. Designer opens with a welcome screen where you can add a data source, upload a file, load a sample, or try a Genie Code prompt.

To start a visual data prep from uploaded files instead, see Start a visual data prep from files. To build your first visual data prep step by step, see Tutorial: Build a visual data prep.

Find your visual data prep files​

To find your existing visual data prep files, open the Visual data prep page from the sidebar. This page lists all of your visual data prep files and includes a getting-started video to help you start using Lakeflow Designer.

Export and import a visual data prep file​

You can export visual data prep files and import them to move them between workspaces or share them.

To export a visual data prep file:

  1. Click Kebab menu icon. in the top-right corner.
  2. Select File > Export.

Designer exports the file as <file_name>.designer.ipynb.

To import from the Visual data prep page:

  1. Click the drop-down arrow next to New, then select Import file.
  2. Select one of the following:
    • As visual data prep: Select a .designer.ipynb file. Designer opens the imported visual data prep in the editor.
    • As source: Upload one or more CSV, JSON, Excel, or PDF files. Designer creates a visual data prep with a Source operator for each file. See Start a visual data prep from files.

To import from the workspace file system:

  1. In the workspace file system, click Kebab menu icon..
  2. Select Import.
  3. Select the visual data prep file to import.

Rename a visual data prep file​

To rename a visual data prep file, click the tab showing its name at the top of the editor, then enter a new name.

Delete a visual data prep file​

To delete a visual data prep file, open the Kebab menu icon. kebab menu for the file and select Move to trash.

To delete multiple visual data prep files at the same time, open Workspace from the left navigation, select the files you want to remove, and select Move to trash at the top of the list.

Review version history​

Click History icon. in the right pane to open the visual data prep's version history, which lists its changes. Select a version to see a visual diff on the canvas that compares it with the following version, with added, removed, and changed operators highlighted. Hovering over an operator in the table of contents highlights the matching operator in both versions of the diff.

Additional resources​