MANAGED_INGESTION_PIPELINE_SPEC_VALIDATION_ERROR error condition
This error condition has the following derived sub error conditions.
APPEND_ONLY_REQUIRES_CURSOR_COLUMNS
APPEND_ONLY can only be used for incremental ingestion of query based connector. The cursor_columns must be set in such cases.
AUTO_FULL_REFRESH_NOT_SUPPORTED_FOR_SCD_TYPE_2
Auto Full Refresh is not supported for SCD Type 2. Please disable auto full refresh or use a different SCD type.
AUTO_FULL_REFRESH_POLICY_CDC_ONLY
Auto Full Refresh Policy can only be set for CDC ingestion pipelines.
AUTO_FULL_REFRESH_POLICY_EMPTY_ENABLED_FIELD
Auto Full Refresh policy enabled must be set.
AUTO_FULL_REFRESH_POLICY_NOT_ENABLED
Auto Full Refresh Policy is not enabled for the org. Contact Databricks support for enabling the feature.
CANNOT_SET_INGESTION_GATEWAY_ID
Cannot set ingestion gateway id because the existing pipeline definition of managed ingestion is missing ingestion gateway id.
CATALOG_MISMATCH
Catalog in the spec does not match the destination_catalog specified in the objects. If you want to use a different destination_catalog, enable DPM via https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/multi-destination-pipeline
CATALOG_REQUIRED_IN_DPM
The catalog must be specified in spec when direct publishing mode is enabled.
CATALOG_SPEC_INCOMPLETE
source_catalog and destination_catalog must be specified for catalog spec.
COLUMN_SELECTION_NOT_ENABLED
Column selection feature is not enabled for database source type <sourceType>: include_columns or exclude_columns can't be specified in table_configurations.
CONNECTION_RETRIEVAL_FAILED
Failed to retrieve connection '<connectionName>' from Unity Catalog. Please check whether the connection exists and contact support if the error persists.
DESTINATION_AND_SOURCE_TABLE_MISMATCH
Destination table should be the same as source table, but got TableSpec: <tableSpec>
DESTINATION_CATALOG_CANNOT_CHANGE
The destination_catalog cannot be changed after pipeline creation. existing destination_catalog: <existingCatalog> new destination_catalog: <newCatalog>.
DESTINATION_SCHEMA_CANNOT_CHANGE
The destination_schema cannot be changed after pipeline creation. existing destination_schema: <existingSchema> new destination_schema: <newSchema>.
DUPLICATE_SOURCE_CATALOG
Duplicate source catalog name in sourceConfigurations: <catalog>.
EMPTY_INGESTION_DEFINITION
The ingestion_definition in pipeline spec needs to be configured.
FOREIGN_CATALOG_SCHEMA_SPEC_INCOMPLETE
source_catalog and source_schema must be specified for foreign_catalog ingestion pipelines in schema spec.
FOREIGN_CATALOG_TABLE_SPEC_INCOMPLETE
source_catalog, source_schema and source_table must be specified for foreign_catalog ingestion pipelines in table spec.
FOREIGN_CATALOG_UNSUPPORTED_SPEC_TYPE
Only table specs and schema specs are supported for foreign_catalog ingestion pipelines. Catalog, report, and identity mapping specs are not allowed.
FULL_REFRESH_WINDOW_CDC_ONLY
Full Refresh Window can only be set for CDC ingestion pipelines.
FULL_REFRESH_WINDOW_NOT_ENABLED
Full Refresh Window is not enabled for the org. Contact Databricks support for enabling the feature.
INCLUDE_COLUMNS_EXCLUDE_COLUMNS_BOTH_SPECIFIED
include_columns and exclude_columns can't be specified together in table_configurations.
INGESTION_GATEWAY_ID_EMPTY
Ingestion gateway ID can't be empty.
INGESTION_GATEWAY_INVALID_OR_DOES_NOT_EXIST
The source ingestion gateway is not valid or does not exist.
INGESTION_GATEWAY_NOT_FOUND
Ingestion Gateway pipeline : <pipelineId> does not exist
INVALID_CHANNEL_FOR_CDC
The channel needs to be <allowedChannels> for ingestion pipeline of CDC Connector.
INVALID_FULL_REFRESH_WINDOW_START_HOUR
Full Refresh Window start_hour must be an integer between 0 and 23.
INVALID_FULL_REFRESH_WINDOW_TIMEZONE
Invalid time zone id: <timeZoneId> passed in Full Refresh Window. Please use one of TZ Database time zones (https://en.wikipedia.org/wiki/List_of_tz_database_time_zones).
LIBRARIES_NOT_ALLOWED
The libraries must be empty for ingestion pipeline.
META_ADS_INVALID_BREAKDOWNS
Invalid Breakdown parameters: <unknownBreakdowns>. Please follow Meta official documentation for the list of allowed breakdowns.
META_ADS_INVALID_LEVEL
Invalid Level Parameter: <level>. Enter one of ad, adset, campaign or account.
META_ADS_INVALID_LOOKBACK_WINDOW
Invalid Click Attribution Window Parameter: <window>. Enter one of 1, 7 or 28.
META_ADS_INVALID_START_DATE
Invalid Start Date Parameter: <date>. Enter in correct YYYY-MM-DD format.
META_ADS_INVALID_TIME_INCREMENT
Invalid Time increment parameter: <days>. It has to be either {monthly, all_days} or a valid positive integer.
MISSING_INGESTION_DEFINITION
Ingestion pipeline settings should contain ingestion_definition.
NETSUITE_JAR_PATH_NOT_SUPPORTED_FOR_SOURCE
netsuite_jar_path is not supported for <sourceType>.
NETSUITE_JAR_PATH_REQUIRED
netsuite_jar_path can't be empty for source: <sourceType>.
NON_EMPTY_MANAGED_DEFINITION
The managed_definition in pipeline spec should not be configured for ingestion pipeline.
POSTGRES_CONFIG_UNSUPPORTED_FOR_SOURCE
PostgreSQL source configuration should only be provided for POSTGRES connector.
POSTGRES_PUBLICATION_NAME_REQUIRED
PostgreSQL publication name cannot be empty or null.
POSTGRES_SLOT_CONFIG_FOR_REPLICATION_CATALOGS_ONLY
PostgreSQL slot configuration has to be provided for all the replication catalogs and not provided for any non-replication catalog.
POSTGRES_SLOT_CONFIG_NOT_ALLOWED
<reason>
POSTGRES_SLOT_NAME_REQUIRED
PostgreSQL slot name cannot be empty or null.
QUERY_BASED_CONNECTOR_CONFIG_EXISTS_FOR_CDC_CONNECTOR
Query-based connector configs are not supported for CDC connector with gateway.
REPORT_SPEC_INCOMPLETE
destination_catalog and destination_schema must be specified for report spec.
SALESFORCE_FORMULA_FIELDS_NOT_SUPPORTED_FOR_SOURCE
salesforce_include_formula_fields is not supported for <sourceType>.
SCD_TYPE_2_NOT_SUPPORTED_FOR_CDC
SCD Type 2 ingestion for CDC managed ingestion pipeline is not supported.
SCD_TYPE_2_NOT_SUPPORTED_FOR_SALESFORCE
SCD Type 2 ingestion for Salesforce ingestion pipeline is not supported.
SCHEMA_MISMATCH
Target in the spec does not match the destination_schema specified in the objects. If you want to use a different destination_schema, enable DPM via https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/multi-destination-pipeline
SCHEMA_NOT_ALLOWED_WITHOUT_DPM
The schema cannot be set when direct publishing mode is not enabled.
SCHEMA_REQUIRED_IN_DPM
The schema must be specified in spec when direct publishing mode is enabled.
SCHEMA_SPEC_INCOMPLETE
source_schema, destination_catalog and destination_schema must be specified for schema spec.
SERVERLESS_MODE_REQUIRED
The serverless mode needs to be true for managed ingestion pipeline with <connectorType> connector.
SOURCE_CATALOG_NAME_REQUIRED
Catalog name has to be provided always for source catalog configuration.
SOURCE_TABLE_REQUIRED
Source table should be present in the table spec, but got TableSpec <tableSpec>
TABLE_SPEC_INCOMPLETE
source_table, destination_catalog and destination_schema must be specified for table spec.
UNSUPPORTED_CONNECTION_TYPE
Connection type '<connectionType>' is not supported for ingestion pipelines.
UNSUPPORTED_SOURCE_OPTION
Found unsupported source option in ingestion_definition. unsupported source option: <source>. Supported source options are connection_name, ingestion_gateway_id, and ingest_from_uc_foreign_catalog.
UNSUPPORTED_SOURCE_TYPE_FOR_QUERY_BASED_CONNECTOR
<sourceType> is not supported for query based connector.
WORKDAY_DESTINATION_TABLE_REQUIRED
Destination table must be set for Workday Reports.
WORKDAY_PRIMARY_KEYS_REQUIRED
Table configurations must be set and primary keys should be specified for Workday Reports.
WORKDAY_REPORT_URL_FORMAT_INVALID
Workday Report URL must include 'format=json' query parameter. URL: <url>.
WORKDAY_REPORT_URL_SYNTAX_INVALID
Invalid Workday Report URL format: <url>.
WORKDAY_REPORT_URL_VALIDATION_ERROR
Error validating Workday Report URL: <error>.