Create a Google Drive connection
Create a Google Drive connection in Catalog Explorer to store authentication credentials for Lakeflow Connect ingestion. Any user with the USE CONNECTION privilege on the connection can then create Google Drive ingestion pipelines without needing direct access to the credentials.
Alternatively, users with the required privileges can create a connection and a pipeline at the same time in the data ingestion UI. See Create an ingestion pipeline.
For privilege requirements, see Connect to managed ingestion sources.
The following authentication methods are supported:
- OAuth U2M: Databricks-managed
- No Google Cloud project or app registration required.
- OAuth U2M: Custom-managed
- Bring your own Google Cloud app.
- OAuth service account
- Authenticates using a Google service account key.
Create a connection
- Databricks-managed
- Custom-managed
- Service account
No Google Cloud project or app registration is required. If OAuth U2M: Databricks-managed isn't listed, use OAuth U2M: Custom-managed.
Sharing a personal account connection grants other users access to your personal account's data.
- In the Databricks workspace, click
Catalog > Create > Create a connection.
- On the Connection basics page of the Set up connection wizard, specify a unique Connection name.
- In the Connection type drop-down menu, select Google Drive.
- In the Auth type drop-down menu, select OAuth U2M: Databricks-managed.
- (Optional) Add a comment.
- Click Next.
- Click Sign in with Google and complete authentication in the pop-up window.
- Click Create connection.
Sharing a personal account connection grants other users access to your personal account's data.
-
Complete the Custom-managed U2M source setup. Use the authentication details that you obtain to create the connection.
-
In the Databricks workspace, click
Catalog > Create > Create a connection.
-
On the Connection basics page of the Set up connection wizard, specify a unique Connection name.
-
In the Connection type drop-down menu, select Google Drive.
-
In the Auth type drop-down menu, select OAuth U2M: Custom-managed.
-
(Optional) Add a comment.
-
Click Next.
-
On the Authentication page, enter the following credentials:
- Client ID: The client ID from the source setup.
- Client secret: The client secret from the source setup.
-
Click Sign in with Google.
You're redirected to the Google authorization page.
-
Sign in with a Google account that can use the app and authorize the requested scopes.
You're redirected to the Databricks workspace.
-
Click Create connection.
- Complete the service account source setup. Use the authentication details that you obtain to create the connection.
- In the Databricks workspace, click
Catalog > Create > Create a connection.
- On the Connection basics page of the Set up connection wizard, specify a unique Connection name.
- In the Connection type drop-down menu, select Google Drive.
- In the Auth type drop-down menu, select OAuth Service Account.
- (Optional) Add a comment.
- Click Next.
- On the Authentication page, enter the following credentials:
- Service account JSON: The contents of the service account key file from the source setup.
- Click Create connection.