Skip to main content
Last updated on

Reddit Ads connector limitations

Beta

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.

Learn about known limitations when using the managed Reddit Ads connector in Lakeflow Connect.

General SaaS connector limitations​

  • When you run a scheduled pipeline, alerts don't trigger immediately. Instead, they trigger when the next update runs.
  • When a source table is deleted, the destination table is not automatically deleted. You must delete the destination table manually. This behavior is not consistent with Spark Declarative Pipelines on Lakeflow behavior.
  • During source maintenance periods, Databricks might not be able to access your data.
  • If a source table name conflicts with an existing destination table name, the pipeline update fails.
  • Multi-destination pipeline support is API-only.
  • You can optionally rename a table that you ingest. If you rename a table in your pipeline, it becomes an API-only pipeline, and you can no longer edit the pipeline in the UI.
  • If you select a column after a pipeline has already started, the connector does not automatically backfill data for the new column. To ingest historical data, manually run a full refresh on the table.
  • Databricks can't ingest two or more tables with the same name in the same pipeline, even if they come from different source schemas.
  • The source system assumes that the cursor columns are monotonically increasing.
  • The connector ingests raw data without transformations. Use downstream Spark Declarative Pipelines on Lakeflow pipelines for transformations.

Supported tables​

The connector only supports the predefined entity and report tables listed in Reddit Ads connector reference, plus user-defined custom reports. The set of entity and report tables is fixed.

Incremental ingestion​

  • Entity tables (ad_account, campaign, ad_group, ad) are fully refreshed on each pipeline update. Only report tables support incremental ingestion.
  • Entity tables do not support history tracking (SCD type 2). Only the current state of each entity is stored.

Report data retention​

The Reddit Ads reporting API only serves report data from approximately the last 24 months. Regardless of the sync_start_date parameter, report tables cannot retrieve data older than this window. Requests for older data are rejected by Reddit. For more information, see Get a report in the Reddit Ads API documentation.

Lookback window​

The lookback_window_days parameter accepts values from 1 to 30. You cannot set a lookback window longer than 30 days.

Custom reports​

  • Custom reports require destination_table to be set — the connector cannot infer a name.
  • The breakdowns list must include at least one time dimension (DATE or HOUR). Omitting a time dimension causes the pipeline to fail at planning time.
  • Breakdown and field values must come from the supported lists in Custom report breakdowns and fields.
On this page