Configure authentication to OpenAI

Beta

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.

This page shows how to configure OpenAI to enable authentication from Databricks for the OpenAI connector. Use the credentials retrieved from the steps on this page to create a Unity Catalog connection in Databricks.

Prerequisites

• An OpenAI account with Organization Owner access. Organization Owners create Admin API keys and manage the organization. Access to the Administration API is gated on this role, not on an account plan tier. See OpenAI: Admin and audit logs API for the API Platform.

• To ingest the audit_logs table, audit logging must be enabled for your organization. Once enabled, audit logging cannot be disabled without contacting OpenAI support. See OpenAI: Admin and audit logs API for the API Platform.

Configure OpenAI

In this step, you create an OpenAI Admin API key. Admin API keys authenticate to the Administration endpoints and cannot be used for other endpoints. For more information, see OpenAI: Administration APIs.

1. Sign in to the OpenAI platform as an Organization Owner.
2. Open the Admin keys page for your organization.
3. Create an Admin API key. Set its permission to Read Only, which sets read permissions for all endpoints and is sufficient for ingestion. See OpenAI: Assign API key permissions.
4. Copy the Admin API key and store it securely. OpenAI shows the full key only once. Use this key to create a Unity Catalog connection in Databricks.
5. To ingest audit logs, confirm that audit logging is enabled for your organization. See OpenAI: Admin and audit logs API for the API Platform.

Next steps

Create an OpenAI connection in Databricks. See Create an OpenAI connection.