OpenAI connector FAQ
This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.
This page answers frequently asked questions about the managed OpenAI ingestion connector in Lakeflow Connect.
General managed connector FAQs
See Managed connector FAQs for FAQs that apply to all Lakeflow Connect managed connectors. The following are specific to the OpenAI connector.
Connector-specific FAQs
What data does the connector ingest?
The connector ingests organization administration data from the OpenAI Organization Admin API. This includes users, projects, invites, API keys, certificates, per-project subresources, daily usage by endpoint, costs, and audit logs. It doesn't ingest model inference data.
Which tables does the connector support?
The connector supports 20 prebuilt tables, including users, projects, invites, admin_api_keys, audit_logs, the usage_* tables, and costs. For the full list and schemas, see Supported source tables.
Which credential does the connector require?
The connector requires an OpenAI Admin API key. A standard API key or service-account key can't call the Administration endpoints. An Organization Owner creates the Admin API key. A Read Only permission is sufficient for ingestion.
Why is the audit_logs table empty?
Audit logging must be enabled for your OpenAI organization before the audit log endpoint returns data. Once enabled, audit logging can't be disabled without contacting OpenAI support. See Configure authentication to OpenAI.
Which tables sync incrementally?
The audit_logs table and the eight usage_* tables sync incrementally on a time cursor. The remaining tables, including costs and the project subresource tables, are full refresh only. See Supported source tables.
Which authentication methods does the connector support?
The connector supports API key authentication using an OpenAI Admin API key. OAuth U2M, OAuth M2M, and basic username/password authentication aren't supported.
What is the source schema for OpenAI tables?
All OpenAI source tables are available under the default source schema.