Set up Delta Sharing for your account
This article describes how data providers (organizations that want to use Delta Sharing to share data securely) perform initial setup of Delta Sharing on Databricks.
Note
If you are a data recipient (an organization that receives data that is shared using Delta Sharing), see instead Read data shared using Databricks-to-Databricks Delta Sharing.
Initial setup includes the following steps:
Enable Delta Sharing for a Databricks account.
Enable Delta Sharing on a Unity Catalog metastore.
(Optional) Install the Unity Catalog CLI.
Configure audits of Delta Sharing activity.
Requirements
At least one Unity Catalog metastore in your account. See Metastores.
Account admin role to enable Delta Sharing for a Unity Catalog metastore.
Metastore admin role to share data using Delta Sharing. See Admin roles for Unity Catalog.
Enable Delta Sharing for your account
To use Delta Sharing to share data securely with external recipients, an account admin must enable the External Data Sharing feature group for your Databricks account.
As a Databricks account admin, log in to the account console.
In the sidebar, click
Settings.
Go to the Feature enablement tab.
On the External Data Sharing Feature Group row, click the Enable button.
Click the Terms link to review the applicable terms for Delta Sharing. Clicking Enable represents acceptance of these terms.
Enable Delta Sharing on a metastore
Follow these steps for each Unity Catalog metastore that manages data that you plan to share using Delta Sharing.
Note
You do not need to enable Delta Sharing on your metastore if you intend to use Delta Sharing only to share data with users on other Unity Catalog metastores in your account. Metastore-to-metastore sharing within a single Databricks account is enabled by default.
As a Databricks account admin, log in to the account console.
In the sidebar, click
Data.
Click the name of a metastore to open its details.
Click the checkbox next to Enable Delta Sharing to allow a Databricks user to share data outside their organization.
Configure the recipient token lifetime.
This configuration sets the period of time after which all recipient tokens expire and must be regenerated. Recipient tokens are used only in the open sharing protocol. Databricks recommends that you configure a default token lifetime rather than allow tokens to live indefinitely.
Note
The recipient token lifetime for existing recipients is not updated automatically when you change the default recipient token lifetime for a metastore. In order to apply a new token lifetime to a given recipient, you must rotate their token. See Manage recipient tokens (open sharing).
To set the default recipient token lifetime:
Confirm that Set expiration is enabled (this is the default).
If you clear this checkbox, tokens will never expire. Databricks recommends that you configure tokens to expire.
Enter a number of seconds, minutes, hours, or days, and select the unit of measure.
Click Enable.
For more information, see Security considerations for tokens.
Optionally enter a name for your organization that a recipient can use to identify who is sharing with them.
Click Enable.
(Optional) Install the Unity Catalog CLI
To manage shares and recipients, you can use Data Explorer, SQL commands, or the Unity Catalog CLI. The CLI runs in your local environment and does not require Databricks compute resources.
To install the CLI, see (Optional) Install the Unity Catalog CLI.
Enable audit logging
As a Databricks account admin, you should enable audit logging to capture Delta Sharing events, such as:
When someone creates, modifies, updates, or deletes a share or a recipient
When a recipient accesses an activation link and downloads the credential (open sharing only)
When a recipient accesses data
When a recipient’s credential is rotated or expires (open sharing only)
Delta Sharing activity is logged at the account level.
To enable audit logging, follow the instructions in Audit log reference.
Important
Delta Sharing activity is logged at the account level. When you configure log delivery, do not enter a value for workspace_ids_filter
.
For detailed information about how Delta Sharing events are logged, see Audit and monitor data sharing using Delta Sharing (for providers).