Configure OAuth U2M for GitHub ingestion

Beta

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.

This page describes how to configure OAuth user-to-machine (U2M) authentication for GitHub ingestion into Databricks.

Prerequisites

To ingest from GitHub, you must have the following:

• A GitHub account with access to the organization you want to ingest data from.
• Permission to create OAuth Apps in your GitHub account's developer settings.

Configure a GitHub OAuth app

1. Go to your GitHub account's developer settings page.

2. In the OAuth Apps section, click New OAuth App.

3. Enter a name and home page URL for your application, along with a description.

4. Set the authorization callback URL to the following:

   https://<your_workspace_domain>/login/oauth/lakehousefederation.html

   For example:

   https://my-databricks-account.cloud.databricks.com/login/oauth/lakehousefederation.html

5. Click Register Application. This takes you to the application's details page.

6. Note the Client ID. You need it when you create your Unity Catalog connection.

7. Click Generate a new client secret to generate a client secret for your application.

8. Note the generated Client Secret. This value is displayed only once.

Next steps

An admin can now use Catalog Explorer to create a connection so that non-admins can create pipelines.