Skip to main content

SAAS_CONNECTOR_DUPLICATE_DATA error condition

SQLSTATE: 42000

Found duplicate data in the table <tableName>. Source type: <sourceName>.

IDENTICAL_ROWS

Found <count> identical row(s): <rowExample>.

Please remove the duplicate rows from the source and run the pipeline again. If the error still persists, then file a ticket.

ROWS_WITH_SAME_PRIMARY_KEY

Primary key(s) <keys> contain duplicates. Found <count> rows for key <keyExample>.

You can either remove the duplicate from the data source or set the field "primary_keys": ["__databricks_id"] in the table_configuration with SCD TYPE 1 and full refresh the impacted table; this creates a hash of all selected columns in the source to enable ingesting the duplicate key.