Skip to main content
Last updated on

Google Search Console connector FAQ

Beta

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.

This page answers frequently asked questions about the managed Google Search Console ingestion connector in Lakeflow Connect. For FAQs that apply to all managed connectors, see Managed connector FAQs.

Which tables does the connector support?​

The connector supports 14 source tables: sites, sitemaps, search_analytics_all_fields, search_analytics_by_country, search_analytics_by_date, search_analytics_by_device, search_analytics_by_page, search_analytics_by_query, search_analytics_page_report, search_analytics_site_report_by_page, search_analytics_site_report_by_site, hourly_search_analytics_page_report, hourly_search_analytics_site_report_by_page, and hourly_search_analytics_site_report_by_site.

For full schema details, see Destination table schemas.

How far back can the connector ingest data?​

For incremental tables, the first sync ingests records from the previous 500 days, and each later sync ingests records after the last run. The sites and sitemaps tables reingest all available records on every run.

To limit the initial lookback window, set the start_date connector option in your pipeline definition. See Connector options.

Which authentication methods does the connector support?​

The connector supports OAuth 2.0 user-to-machine (U2M) and Service Account (OAuth 2.0 machine-to-machine, or M2M) authentication. Basic authentication (username/password or API key) is not supported.

Use Service Account authentication for automated, unattended pipelines or for Google Workspace environments that use domain-wide delegation to impersonate a specific user. Use OAuth U2M to authenticate as your own Google identity interactively.

For setup instructions, see Configure authentication to Google Search Console.

Can the connector ingest data from multiple site URLs in one pipeline?​

Yes. Specify multiple values in the site_urls connector option. The connector creates a partition for each site URL and ingests all tables for each property. All destination tables include a site_url column to identify the source property.

Which search types does the connector ingest?​

The search types ingested depend on the table:

  • Daily search_analytics_all_fields and search_analytics_by_query tables: web, news, image, video.
  • Daily search_analytics_by_country, search_analytics_by_date, search_analytics_by_page, and search_analytics_site_report_by_site tables: web, news, image, video, discover, googleNews.
  • Daily search_analytics_by_device, search_analytics_page_report, and search_analytics_site_report_by_page tables: web, news, image, video, googleNews.
  • Hourly tables: data is available for web and googleNews search types only.

Why does the connector not ingest data for recent dates?​

Google Search Console Search Analytics data has an approximate delay of two to four days. Clicks, impressions, CTR, and position metrics for recent dates appear in the API after this delay. The connector ingests data as it becomes available in subsequent pipeline runs.

On this page