Python programming for Delta Live Tables

The articles linked here provide guidance for using Python to perform programming tasks with Delta Live Tables. These recommendations assume familiarity with concepts and patterns in the following articles:

Note

Patterns shown in this article cannot be easily completed with only SQL. Because Python datasets can be defined against any query that returns a DataFrame, you can use spark.sql() as necessary to leverage SQL syntax within Python functions.

You can use Python user-defined functions (UDFs) in your SQL queries, but you must define these UDFs in Python files in the same pipeline before calling them in SQL source files. See User-defined scalar functions - Python.