Error conditions in Databricks

Failed to compare the two job runs.

For more details see AI_COMPARE_JOBS_ERROR

AI_DIAGNOSE_ERROR

Failed to diagnose the issue.

For more details see AI_DIAGNOSE_ERROR

AI_DIAGNOSE_NO_LOG_DELIVERY

Cluster <clusterId> does not have cluster log delivery configured. AI_DIAGNOSE requires cluster log delivery to access driver logs, event logs, and executor logs for diagnosis.

AI_FUNCTIONS_DISABLED

AI functions are disabled for this workspace. Your account or workspace administrator can enable AI functions.

AI_FUNCTION_COMPILATION_ERROR

An error occurred while compiling the AI function: <statusCode>: <errorMessage>

AI_FUNCTION_HTTP_PARSE_CAST_ERROR

Failed to parse model output when casting to the specified returnType: "<dataType>", response JSON was: "<responseString>". Please update the returnType to match the contents of the type represented by the response JSON and then retry the query again. Exception: <errorMessage>

AI_FUNCTION_HTTP_PARSE_COLUMNS_ERROR

The actual model output has more than one column "<responseString>". However, the specified return type["<dataType>"] has only one column. Please update the returnType to contain the same number of columns as the model output and then retry the query again.

AI_FUNCTION_HTTP_REQUEST_ERROR

Error occurred while making an HTTP request for function <funcName>: <errorMessage>

AI_FUNCTION_INVALID_HTTP_RESPONSE

Invalid HTTP response for function <funcName>: <errorMessage>

AI_FUNCTION_INVALID_MAX_WORDS

The maximum number of words must be a non-negative integer, but got <maxWords>.

AI_FUNCTION_INVALID_MODEL_PARAMETERS

The provided model parameters (<modelParameters>) are invalid in the AI_QUERY function for serving endpoint "<endpointName>".

For more details see AI_FUNCTION_INVALID_MODEL_PARAMETERS

AI_FUNCTION_INVALID_RESPONSE_FORMAT_TYPE

AI function: "<functionName>" requires valid <format> string for responseFormat parameter, but found the following response format: "<invalidResponseFormat>". Exception: <errorMessage>

AI_FUNCTION_JSON_PARSE_ERROR

Error occurred while parsing the JSON response for function <funcName>: <errorMessage>

AI_FUNCTION_MODEL_SCHEMA_PARSE_ERROR

Failed to parse the schema for the serving endpoint "<endpointName>": <errorMessage>, response JSON was: "<responseJson>".

Set the returnType parameter manually in the AI_QUERY function to override schema resolution.

AI_FUNCTION_REGISTRY_LOOKUP_FAILURE

AI_FUNCTION_UNSUPPORTED_RETURN_TYPE

AI function: "<functionName>" does not support the following type as return type: "<typeName>". Return type must be a valid SQL type understood by Catalyst and supported by AI function. Current supported types includes: <supportedValues>

AI_GENERATE_DESC_FAILURE

Failed to generate table description: <errorMessage>

AI_INVALID_ARGUMENT_VALUE_ERROR

Provided value "<argValue>" is not supported by argument "<argName>". Supported values are: <supportedValues>

AI_PREDICT_INSUFFICIENT_TRAINING_DATA

The function <funcName> does not have adequate training data to fit a model.

For more details see AI_PREDICT_INSUFFICIENT_TRAINING_DATA

AI_PREDICT_INVALID_PARAMETER

See 'https://spark.apache.org/docs/latest/sql-migration-guide.html#query-engine'.

AMBIGUOUS_COLUMN_OR_FIELD

Column or field <name> is ambiguous and has <n> matches.

AMBIGUOUS_COLUMN_REFERENCE

Column <name> is ambiguous. It's because you joined several DataFrame together, and some of these DataFrames are the same.

This column points to one of the DataFrames but Spark is unable to figure out which one.

Please alias the DataFrames with different names via DataFrame.alias before joining them,

and specify the column using qualified name, for example, df.alias("a").join(df.alias("b"), col("a.id") > col("b.id")).

AMBIGUOUS_CONSTRAINT

SQLSTATE: 42K0C

Ambiguous reference to constraint <constraint>.

AMBIGUOUS_LATERAL_COLUMN_ALIAS

Lateral column alias <name> is ambiguous and has <n> matches.

AMBIGUOUS_REFERENCE

Reference <name> is ambiguous, could be: <referenceNames>.

AMBIGUOUS_REFERENCE_TO_FIELDS

ARITHMETIC_OVERFLOW

<message>.<alternative> If necessary set <config> to "false" to bypass this error.

For more details see ARITHMETIC_OVERFLOW

ARRAY_AGG_WITH_LIMIT_NOT_SUPPORTED_OUTSIDE_ROLLING_WINDOW

For more details see AS_OF_JOIN

ATTEMPT_ANALYSIS_IN_PIPELINE_QUERY_FUNCTION

Operations that trigger DataFrame analysis or execution are not allowed in pipeline query functions. Move code outside of the pipeline query function.

AUTOCDC_BOTH_COLUMN_LIST_AND_EXCEPT_COLUMN_LIST

AutoCDC flow specifies both column_list and except_column_list; at most one may be provided.

AUTOCDC_BOTH_TRACK_HISTORY_COLUMN_LIST_AND_EXCEPT_COLUMN_LIST

AutoCDC flow specifies both track_history_column_list and track_history_except_column_list; at most one may be provided.

AutoCDC flow is missing a required source table name. Specify the name of the streaming source table the flow should read from.

AUTOCDC_MULTIPART_COLUMN_IDENTIFIER

Expected a single column identifier; got the multi-part identifier <columnName> (parts: <nameParts>).

AUTOCDC_MULTIPLE_FLOWS_TO_TARGET

Invalid AutoCDC destination <tableName> with multiple flows: <flows>. An AutoCDC target table must have exactly one flow writing to it.

AUTOCDC_NON_COLUMN_IDENTIFIER

Expected a column identifier; got the non-attribute expression <expression>. AutoCDC keys, sequence_by, column_list, and except_column_list must reference unqualified column names.

AUTOCDC_RESERVED_COLUMN_NAME_CONFLICT

The column <columnName> in the <schemaName> schema collides with a reserved AutoCDC <scdType> column name (using <caseSensitivity> column name comparison). The following column names are reserved by AutoCDC and cannot appear in the source: <reservedColumnNames>. Rename or remove the column.

AUTOCDC_RESERVED_COLUMN_NAME_PREFIX_CONFLICT

The column <columnName> in the <schemaName> schema collides with the reserved AutoCDC column name prefix <reservedColumnNamePrefix> (using <caseSensitivity> column name comparison). Rename or remove the column.

AUTOCDC_TARGET_DOES_NOT_SUPPORT_MERGE

Cannot start AutoCDC flow: the target table <tableName> (format: <format>) does not support row-level operations. AutoCDC requires a target backed by a connector that supports MERGE.

AUTOCDC_TRACK_HISTORY_REQUIRES_SCD2

AutoCDC flow specifies track_history_column_list or track_history_except_column_list but is not stored as SCD Type 2; history-tracking columns are only supported for SCD Type 2 target tables.

AUTOCOMMIT_BEGIN_TRANSACTION_DURING_AUTOCOMMIT_TRANSACTION

Cannot start a new transaction while an implicit transaction started by SET AUTOCOMMIT=FALSE is active. COMMIT or ROLLBACK the current transaction first and SET AUTOCOMMIT=TRUE before starting a new transaction.

AUTOCOMMIT_NOT_SUPPORTED

AUTOCOMMIT is not enabled in this Databricks environment. AUTOCOMMIT is only supported on Databricks SQL warehouses.

AUTOCOMMIT_OLD_SQL_EDITOR_NOT_SUPPORTED

AUTOCOMMIT cannot be accessed or modified in the legacy SQL Editor. Switch to the new SQL Editor (<docLink>) or use a notebook connected with a Databricks SQL warehouse.

AUTOCOMMIT_ONLY_SUPPORTED_IN_DBSQL

AUTOCOMMIT can only be accessed or modified in Databricks SQL warehouses.

AUTOCOMMIT_SET_DURING_ACTIVE_TRANSACTION

Changing AUTOCOMMIT is not allowed during an active interactive transaction. COMMIT or ROLLBACK the current transaction first.

AUTOCOMMIT_SET_FALSE_ALREADY_DISABLED

SET AUTOCOMMIT=FALSE is not allowed when AUTOCOMMIT is already disabled. Run SET AUTOCOMMIT to check the current state.

AUTOCOMMIT_SET_TRUE_DURING_AUTOCOMMIT_TRANSACTION

SET AUTOCOMMIT=TRUE is not allowed after statements have executed in an implicit transaction started by SET AUTOCOMMIT=FALSE. It is only allowed immediately after SET AUTOCOMMIT=FALSE (before any statements), or after COMMIT or ROLLBACK.

AUTO_CDC_BITEMPORAL_REQUIRES_SYSTEM_SEQUENCE_BY

STORED AS BITEMPORAL requires a SYSTEM SEQUENCE BY clause.

AUTO_CDC_SYSTEM_SEQUENCE_BY_REQUIRES_BITEMPORAL

SYSTEM SEQUENCE BY can only be used with STORED AS BITEMPORAL.

AUTO_INDEX_FEATURE_NOT_ENABLED

Auto index feature is not enabled for your account. To enable it, contact your Databricks representative.

AUTO_TTL_COLUMN_NOT_FOUND

Invalid table schema for Auto-TTL. Auto-TTL column <column> cannot be found.

AUTO_TTL_COLUMN_TYPE_NOT_SUPPORTED

Auto-TTL column <column> has type <type> which is invalid. Column type has to be one of TIMESTAMP, TIMESTAMP_NTZ, or DATE.

AUTO_TTL_FEATURE_NOT_ENABLED

Please contact your Databricks representative to enable the Auto-TTL feature.

AUTO_TTL_INCOMPLETE_SETTING

To set Auto-TTL on a table, both table properties autottl.timestampColumn and autottl.expireInDays are required, but <missing> is missing.

AUTO_TTL_INVALID_COLUMN_CHANGE

Column <column> cannot be <operation> since it's used in the definition of Auto-TTL.

AUTO_TTL_NOT_SUPPORT_SHALLOW_CLONES

Auto-TTL is not supported on shallow clone tables.

AUTO_TTL_NOT_SUPPORT_TABLES_HAVING_SHALLOW_CLONES

Auto-TTL is not supported on tables that have shallow clones.

AUTO_TTL_REQUIRES_PREDICTIVE_OPTIMIZATION

Auto-TTL requires Predictive Optimization to be enabled.

AUTO_TTL_REQUIRES_UC_MANAGED_TABLE

Auto-TTL is only supported on UC Managed tables.

AVRO_CANNOT_WRITE_NULL_FIELD

SQLSTATE: 22004

Cannot write null value for field <name> defined as non-null Avro data type <dataType>.

To allow null value for this field, specify its avro schema as a union type with "null" using avroSchema option.

AVRO_DATA_SOURCE_NOT_ENABLED

Failed to find data source: <provider>. Avro is built-in but external data source module since Spark 2.4. Please deploy the application as per the deployment section of Apache Avro Data Source Guide.

SQLSTATE: 42KDK

Azure key provider or credentials are configured incorrectly. Reason: <causedBy>.

BATCH_METADATA_NOT_FOUND

Unable to find batch <batchMetadataFile>.

BEAN_ENCODER_INTERFACE_NOT_SUPPORTED

Bean encoder does not support interface type <className>.

BIGQUERY_DATA_SOURCE_OPTIONS_VALIDATION_FAILED

The BigQuery data source option(s) validation failed.

For more details see BIGQUERY_DATA_SOURCE_OPTIONS_VALIDATION_FAILED

BIGQUERY_OPTIONS_ARE_MUTUALLY_EXCLUSIVE

BigQuery connection credentials must be specified with either the 'GoogleServiceAccountKeyJson' parameter or all of 'projectId', 'OAuthServiceAcctEmail', 'OAuthPvtKey'

BINARY_ARITHMETIC_OVERFLOW

<value1> <symbol> <value2> caused overflow. Use <functionName> to ignore overflow problem and return NULL.

BINARY_FILE_DATA_SOURCE_SCHEMA_MISMATCH

Cannot cache the DataFrame: the session has reached the maximum of <maxActiveEntries> cached DataFrames. To make room, call df.unpersist() on a cached DataFrame you no longer need. Note that any DataFrame derived from that one also becomes unusable.

CACHE_DATAFRAME_ACCESS_AFTER_UNCACHE

This DataFrame, or a DataFrame it was derived from, has been uncached and can no longer be accessed. Create a new DataFrame from the original data source to continue working with the data.

CACHE_ENTRY_RESOLUTION_FAILED

CANNOT_COPY_STATE

SQLSTATE: 0AKD0

Cannot copy catalog state like current database and temporary views from Unity Catalog to a legacy catalog.

CANNOT_CREATE_DATA_SOURCE_TABLE

Failed to create data source table <tableName>:

For more details see CANNOT_CREATE_DATA_SOURCE_TABLE

CANNOT_DECODE_URL

The provided URL cannot be decoded: <url>. Please ensure that the URL is properly formatted and try again.

CANNOT_DELETE_SYSTEM_OWNED

System owned <resourceType> cannot be deleted.

CANNOT_DROP_AMBIGUOUS_CONSTRAINT

SQLSTATE: 42K0C

Cannot drop the constraint with the name <constraintName> shared by a CHECK constraint

and a PRIMARY KEY or FOREIGN KEY constraint. You can drop the PRIMARY KEY or

FOREIGN KEY constraint by queries:

ALTER TABLE .. DROP PRIMARY KEY or

ALTER TABLE .. DROP FOREIGN KEY ..

CANNOT_DROP_BASE_TABLE_REFERENCED_BY_SHALLOW_CLONE

Cannot drop table <baseTable> because it is referenced by one or more shallow clone(s): <cloneList>. DROP all shallow clones before dropping the base table. If this is not possible, consider to use 'DROP TABLE ... FORCE' to drop the table forcefully. WARNING: This will immediately break all existing shallow clone references and make them unusable.

CANNOT_ESTABLISH_CONNECTION

Cannot establish connection to remote <jdbcDialectName> database. Please check connection information and credentials for example, host, port, user, password and database options. ** If you believe the information is correct, please check your workspace's network setup and ensure it does not have outbound restrictions to the host. Please also check that the host does not block inbound connections from the network where the workspace's Spark clusters are deployed. ** Detailed error message: <causeErrorMessage>.

CANNOT_ESTABLISH_CONNECTION_SERVERLESS

Cannot establish connection to remote <jdbcDialectName> database. Please check connection information and credentials for example, host, port, user, password and database options. ** If you believe the information is correct, please allow inbound traffic from the Internet to your host, as you are using Serverless Compute. If your network policies do not allow inbound Internet traffic, please use non Serverless Compute, or you may reach out to your Databricks representative to learn about Serverless Private Networking. ** Detailed error message: <causeErrorMessage>.

CANNOT_ESTABLISH_CONNECTION_TO_HOST

Cannot establish <protocol> connection to <host>. Please check your workspace's network setup and ensure it does not have outbound restrictions to the host. Please also check that the host does not block inbound connections from the network where the workspace's clusters are deployed.

CANNOT_INSTANTIATE_HIVE_FUNCTION

Cannot instantiate the Hive UDF/UDAF/UDTF wrapper class <clazz>. Check that the function arguments and their types are supported.

CANNOT_INVOKE_IN_TRANSFORMATIONS

Dataset transformations and actions can only be invoked by the driver, not inside of other Dataset transformations; for example, dataset1.map(x => dataset2.values.count() * x) is invalid because the values transformation and count action cannot be performed inside of the dataset1.map transformation. For more information, see SPARK-28702.

CANNOT_LOAD_CATALOG

SQLSTATE: 46103

Cannot load catalog '<name>' with the plugin class '<pluginClassName>':

For more details see CANNOT_LOAD_CATALOG

CANNOT_LOAD_CHECKPOINT_FILE_MANAGER

Error loading streaming checkpoint file manager for path=<path>.

For more details see CANNOT_LOAD_CHECKPOINT_FILE_MANAGER

CANNOT_LOAD_FUNCTION_CLASS

SQLSTATE: 46103

Cannot load class <className> when registering the function <functionName>, please make sure it is on the classpath.

CANNOT_LOAD_PROTOBUF_CLASS

Could not load Protobuf class with name <protobufClassName>. <explanation>.

CANNOT_LOAD_STATE_STORE

An error occurred during loading state.

For more details see CANNOT_LOAD_STATE_STORE

CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE

SQLSTATE: 42825

Failed to merge incompatible data types <left> and <right>. Please check the data types of the columns being merged and ensure that they are compatible. If necessary, consider casting the columns to compatible data types before attempting the merge.

CANNOT_MERGE_SCHEMAS

Failed merging schemas:

Initial schema:

<left>

Schema that cannot be merged with the initial schema:

<right>.

CANNOT_MODIFY_CONFIG

SQLSTATE: 46110

Cannot modify the value of the Spark config: <key>.

CANNOT_MODIFY_STATIC_CONFIG

SQLSTATE: 46110

Cannot modify the value of the static Spark config: <key>.

CANNOT_PARSE_DECIMAL

Cannot parse decimal. Please ensure that the input is a valid number with optional decimal point or comma separators.

CANNOT_PARSE_INTERVAL

Unable to parse <intervalString>. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format. If the issue persists, please double check that the input value is not null or empty and try again.

CANNOT_PARSE_JSON_FIELD

Cannot parse the field name <fieldName> and the value <fieldValue> of the JSON token type <jsonType> to target Spark data type <dataType>.

CANNOT_PARSE_PROTOBUF_DESCRIPTOR

Error parsing descriptor bytes into Protobuf FileDescriptorSet.

CANNOT_PARSE_TIME

SQLSTATE: 22010

The input string <input> cannot be parsed to a TIME value because it does not match to the datetime format <format>.

CANNOT_PARSE_TIMESTAMP

SQLSTATE: 22007

<message>. Use <func> to tolerate invalid input string and return NULL instead.

CANNOT_QUERY_TABLE_DURING_INITIALIZATION

Cannot query MV/ST during initialization.

For more details see CANNOT_QUERY_TABLE_DURING_INITIALIZATION

CANNOT_READ_ARCHIVED_FILE

Cannot read file at path <path> because it has been archived. Please adjust your query filters to exclude archived files.

CANNOT_READ_FILE

CANNOT_TRUNCATE_EXTERNAL_TABLE

Operation not allowed: TRUNCATE TABLE on external tables: <tableName>.

CANNOT_UPDATE_FIELD

Cannot update <table> field <fieldName> type:

For more details see CANNOT_UPDATE_FIELD

CANNOT_UPDATE_PARTITION_COLUMNS

Declared partitioning <requestedPartitionColumns> conflicts with existing table partitioning <existingPartitionColumns>.

Please delete the table or change the declared partitioning to match its partitions.

CANNOT_UP_CAST_DATATYPE

Cannot up cast <expression> from <sourceType> to <targetType>.

<details>

CANNOT_USE_KRYO

SQLSTATE: 22KD3

Cannot load Kryo serialization codec. Kryo serialization cannot be used in the Spark Connect client. Use Java serialization, provide a custom Codec, or use Spark Classic instead.

CANNOT_USE_MULTI_ALIASES_IN_WATERMARK_CLAUSE

Multiple aliases are not supported in watermark clause.

CANNOT_USE_RESERVED_STREAMING_PROVIDER_NAME

Cannot use reserved streaming provider name: <providerName>.

CANNOT_VALIDATE_CONNECTION

Validation of <jdbcDialectName> connection is not supported. Please contact Databricks support for alternative solutions, or set "spark.databricks.testConnectionBeforeCreation" to "false" to skip connection testing before creating a connection object.

CANNOT_WRITE_MANAGED_FILE_AS_EXTERNAL

SQLSTATE: 42821

Cannot write a MANAGED FILE reference to an EXTERNAL FILE column. Convert the MANAGED FILE into an EXTERNAL FILE with copy_file().

CANNOT_WRITE_STATE_STORE

Error writing state store files for provider <providerClass>.

For more details see CANNOT_WRITE_STATE_STORE

CAST_INVALID_INPUT

The value <expression> of the type <sourceType> cannot be cast to <targetType> because it is malformed. Correct the value as per the syntax, or change its target type. Use try_cast to tolerate malformed input and return NULL instead.

For more details see CAST_INVALID_INPUT

CAST_OVERFLOW

The value <value> of the type <sourceType> cannot be cast to <targetType> due to an overflow. Use try_cast to tolerate overflow and return NULL instead.

CAST_OVERFLOW_IN_TABLE_INSERT

Fail to assign a value of <sourceType> type to the <targetType> type column or variable <columnName> due to an overflow. Use try_cast on the input value to tolerate overflow and return NULL instead.

CAST_TO_FILE_TYPE

Cannot CAST <sourceType> to FILE.

For more details see CAST_TO_FILE_TYPE

CATALOG_ALREADY_EXISTS

SQLSTATE: 42KDN

Cannot create catalog <catalogName> because it already exists.

Choose a different name, drop or replace the existing catalog, or add the IF NOT EXISTS clause to tolerate a pre-existing catalog.

CATALOG_CONVERSION_FOREIGN_ENTITY_PRESENT

Catalog conversion from UC Foreign to UC Standard failed because catalog contains foreign entities (up to 10 are shown here): <entityNames>. To see the full list of foreign entities in this catalog, please refer to the scripts in 'ALTER CATALOG DROP CONNECTION' command documentation.

CATALOG_CONVERSION_UNSUPPORTED_CATALOG_TYPE

Catalog cannot be converted from UC Foreign to UC Standard. Only <convertableCatalogTypes> Foreign UC catalogs can be converted to UC Standard.

CATALOG_MANAGED_TABLE_ACCESS_NOT_SUPPORTED

Cannot access the streaming table or materialized view <tableName>: accessing a catalog-managed table is only supported on a shared or serverless cluster. If the issue persists after switching, please contact Databricks support.

CATALOG_MANAGED_TABLE_CREATION_NOT_ALLOWED

Creating Delta tables with <feature> table feature is not allowed. Please contact Databricks support.

CATALOG_MANAGED_TABLE_CREATION_ON_NON_UC_MANAGED_NOT_ALLOWED

Creating Delta tables with the catalog-managed table feature is only supported for Unity Catalog managed tables.

CATALOG_NOT_FOUND

SQLSTATE: 42P08

The catalog <catalogName> not found. Consider to set the SQL config <config> to a catalog plugin.

CHECKPOINT_DIR_NOT_SET

Checkpoint directory has not been set in the SparkContext.

Please set it with SparkContext.setCheckpointDir().

CHECKPOINT_RDD_BLOCK_ID_NOT_FOUND

Checkpoint block <rddBlockId> not found!

Either the executor that originally checkpointed this partition is no longer alive, or the original RDD is unpersisted.

If this problem persists, you may consider using rdd.checkpoint() instead, which is slower than local checkpointing but more fault-tolerant.

CHECK_CONSTRAINT_VIOLATION

SQLSTATE: 23001

CHECK constraint <constraintName> <expression> violated by row with values:

<values>

CIRCULAR_CLASS_REFERENCE

Cannot have circular references in class, but got the circular reference of class <t>.

CLASS_NOT_OVERRIDE_EXPECTED_METHOD

<className> must override either <method1> or <method2>.

CLASS_UNSUPPORTED_BY_MAP_OBJECTS

MapObjects does not support the class <cls> as resulting collection.

CLEANROOM_COMMANDS_NOT_SUPPORTED

Clean Room commands are not supported

CLEANROOM_INVALID_SHARED_DATA_OBJECT_NAME

Invalid name to reference a <type> inside a Clean Room. Use a <type>'s name inside the clean room following the format of [catalog].[schema].[<type>].

If you are unsure about what name to use, you can run "SHOW ALL IN CLEANROOM [clean_room]" and use the value in the "name" column.

CLONING_WITH_HISTORY_INVALID_OPTION

Cloning with history is specified with an invalid option: <invalidOption>.

Valid syntax: CREATE (OR REPLACE) TABLE ... DEEP CLONE ... WITH HISTORY.

CLONING_WITH_HISTORY_UNSUPPORTED

Cloning with history is not supported.

CLOUDFILES_SCHEMA_LOCATION_REQUIRED

Could not find required option: schemaLocation. Provide a schema location using cloudFiles.schemaLocation for storing the inferred schema and supporting schema evolution.

CLOUD_ACCESS_DENIED

SQLSTATE: 42KDM

Access denied to <path> cloud path for <operation> operation. Cloud provider error message: <original>

CLOUD_FILE_ALREADY_EXISTS

Cloud file already exists. Reason: <causedBy>.

CLOUD_FILE_NOT_FOUND

Cloud file is not found. Reason: <causedBy>.

CLOUD_FILE_SOURCE_FILE_NOT_FOUND

A file notification was received for file: <filePath> but it does not exist anymore. Please ensure that files are not deleted before they are processed. To continue your stream, you can set the Spark SQL configuration <config> to true.

CLOUD_INVALID_PATH

The specified path contains invalid characters and cannot be resolved. Path: <path>. Reason: <reason>

CLOUD_IO_INVALID_ARGUMENT

Cloud storage request rejected as invalid: <request_context_and_error_msg>

CLOUD_PROVIDER_ERROR

Cloud provider error: <message>

CLUSTERING_COLUMNS_MISMATCH

For more details see COLLATION_MISMATCH

COLLECTION_SIZE_LIMIT_EXCEEDED

Can't create array with <numberOfElements> elements which exceeding the array size limit <maxRoundedArrayLength>,

For more details see COLLECTION_SIZE_LIMIT_EXCEEDED

<schema>

COLUMN_NOT_FOUND_IN_TABLE

Column <columnName> not found in table <tableFullName>.

COLUMN_ORDINAL_OUT_OF_BOUNDS

Column ordinal out of bounds. The number of columns in the table is <attributesLength>, but the column ordinal is <ordinal>.

Attributes are the following: <attributes>.

COMMAND_NOT_APPLICABLE_TO_TABLE

<command> does not apply to table <tableName>.

For more details see COMMAND_NOT_APPLICABLE_TO_TABLE

COMMAND_NOT_ENABLED

<command> command is not enabled.

COMMA_PRECEDING_CONSTRAINT_ERROR

Unexpected ',' before constraint(s) definition. Ensure that the constraint clause does not start with a comma when columns (and expectations) are not defined.

COMMENT_ON_CONNECTION_NOT_IMPLEMENTED_YET

The COMMENT ON CONNECTION command is not implemented yet

COMPARATOR_RETURNS_NULL

SQLSTATE: 22004

The comparator has returned a NULL for a comparison between <firstValue> and <secondValue>.

It should return a positive integer for "greater than", 0 for "equal" and a negative integer for "less than".

To revert to deprecated behavior where NULL is treated as 0 (equal), you must set "spark.sql.legacy.allowNullComparisonResultInArraySort" to "true".

COMPLEX_EXPRESSION_UNSUPPORTED_INPUT

Cannot process input data types for the expression: <expression>.

For more details see COMPLEX_EXPRESSION_UNSUPPORTED_INPUT

CONCURRENT_QUERY

Another instance of this query [id: <queryId>] was just started by a concurrent session [existing runId: <existingQueryRunId> new runId: <newQueryRunId>].

CONCURRENT_SCHEDULER_INSUFFICIENT_SLOT

SQLSTATE: 53000

The minimum number of free slots required in the cluster is <numTasks>, however, the cluster has only has <numSlots> slots free. Query will stall or fail. Increase cluster size to proceed.

CONCURRENT_STREAM_LOG_UPDATE

Concurrent update to the log. Multiple streaming jobs detected for <batchId>.

Please make sure only one streaming job runs on a specific checkpoint location at a time.

CONFIG_NOT_AVAILABLE

Configuration <config> is not available.

For more details see CONFIG_NOT_AVAILABLE

CONFLICTING_CLUSTER_CONFIGURATION

The following configuration(s) conflict with spark.databricks.streaming.realTimeMode.enabled: <confNames>. Remove these configurations from your cluster configuration and restart your Spark cluster.

CONFLICTING_DIRECTORY_STRUCTURES

Conflicting directory structures detected.

Suspicious paths:

<discoveredBasePaths>

If provided paths are partition directories, please set "basePath" in the options of the data source to specify the root directory of the table.

If there are multiple root directories, please load them separately and then union them.

CONFLICTING_PARTITION_COLUMN_NAMES

Conflicting partition column names detected:

<distinctPartColLists>

For partitioned table directories, data files should only live in leaf directories.

And directories at the same level should have the same partition column name.

Please check the following directories for unexpected files or inconsistent partition column names:

<suspiciousPaths>

CONFLICTING_PARTITION_COLUMN_NAME_WITH_RESERVED

Partition column name '<partitionColumnName>' conflicts with reserved column name.

The schema of <tableName> is Hive-incompatible, Spark automatically generates a reserved column '<partitionColumnName>' to store the table in a specific way.

Please use a different name for the partition column.

CONFLICTING_PROVIDER

The specified provider <provider> is inconsistent with the existing catalog provider <expectedProvider>. Please use 'USING <expectedProvider>' and retry the command.

CONFLICTING_SQL_CONFIGURATION

The following configuration(s) conflict with spark.databricks.streaming.realTimeMode.enabled: <confNames>. Remove these configurations from your SparkSession configuration.

CONNECT

SQLSTATE: 56K00

Generic Spark Connect error.

For more details see CONNECT

CONNECTION_ALREADY_EXISTS

SQLSTATE: 56K00

The Spark Connect plan is invalid.

For more details see CONNECT_INVALID_PLAN

CONNECT_LOCAL_CREDENTIAL_PROPERTY_MISSING

Required SparkContext local property <property> was not found for session <sessionId>.

CONNECT_ML

Spark Connect ML error:

For more details see CONNECT_ML

CONNECT_SESSION_MIGRATION

SQLSTATE: 56K00

Generic Session Migration error (userId: <userId>, sessionId: <sessionId>, serverSessionId: <serverSessionId>).

For more details see CONNECT_SESSION_MIGRATION

CONSTRAINTS_REQUIRE_UNITY_CATALOG

Table constraints are only supported in Unity Catalog.

CONSTRAINT_ALREADY_EXISTS

Constraint '<constraintName>' already exists. Please delete the existing constraint first.

Existing constraint:

<oldConstraint>

CONSTRAINT_ALREADY_EXISTS_IN_SCHEMA

Constraint <constraintName> already exists in database <schemaName>.

CONSTRAINT_ALREADY_EXISTS_WITH_SERVER_MESSAGE

<serverMessage>

CONSTRAINT_DOES_NOT_EXIST

Cannot drop nonexistent constraint <constraintName> from table <tableName>.

CONVERSION_INVALID_INPUT

The value <str> (<fmt>) cannot be converted to <targetType> because it is malformed. Correct the value as per the syntax, or change its format. Use <suggestion> to tolerate malformed input and return NULL instead.

COPY_FILE_AUTHORIZATION_ERROR

Authorization error while copying a file.

For more details see COPY_FILE_AUTHORIZATION_ERROR

COPY_FILE_ERROR

Error copying a file.

For more details see COPY_FILE_ERROR

COPY_FILE_ILLEGAL_USAGE

SQLSTATE: none assigned

Illegal usage of COPY_FILE.

For more details see COPY_FILE_ILLEGAL_USAGE

COPY_INTO_COLUMN_ARITY_MISMATCH

This may indicate an issue with the incoming data, or the Delta table schema can be evolved automatically according to the incoming data by setting:

COPY_OPTIONS ('mergeSchema' = 'true')

Schema difference:

<schemaDiff>

COPY_INTO_SOURCE_FILE_FORMAT_NOT_SUPPORTED

The format of the source files must be one of CSV, JSON, AVRO, ORC, PARQUET, TEXT, or BINARYFILE. Using COPY INTO on Delta tables as the source is not supported as duplicate data may be ingested after OPTIMIZE operations. This check can be turned off by running the SQL command set spark.databricks.delta.copyInto.formatCheck.enabled = false.

COPY_INTO_SOURCE_SCHEMA_INFERENCE_FAILED

The source directory did not contain any parsable files of type <format>. Please check the contents of '<source>'.

The error can be silenced by setting '<config>' to 'false'.

COPY_INTO_STATE_INTERNAL_ERROR

An internal error occurred while processing COPY INTO state.

For more details see COPY_INTO_STATE_INTERNAL_ERROR

COPY_INTO_SYNTAX_ERROR

Failed to parse the COPY INTO command.

For more details see COPY_INTO_SYNTAX_ERROR

COPY_INTO_UNSUPPORTED_FEATURE

The COPY INTO feature '<feature>' is not supported.

COPY_UNLOAD_FORMAT_TYPE_NOT_SUPPORTED

Cannot unload data in format '<formatType>'. Supported formats for <connectionType> are: <allowedFormats>.

CORRUPTED_CATALOG_FUNCTION

Cannot convert the catalog function '<identifier>' into a SQL function due to corrupted function information in catalog. If the function is not a SQL function, please make sure the class name '<className>' is loadable.

COUNTER_DIFF_NEGATIVE_COUNTER_VALUE

A negative counter value <value> was provided to function <function>. Negative counter values are not allowed.

COUNTER_DIFF_START_TIME_DECREASED

Start time provided to function <function> decreased from <previousStartTime> to <currentStartTime>. Start time is required to be non-decreasing.

CREATE_EXTERNAL_TABLE_WITHOUT_LOCATION

CREATE EXTERNAL TABLE must be accompanied by LOCATION.

CREATE_FILE_ERROR

Error creating a file.

For more details see CREATE_FILE_ERROR

CREATE_FILE_ILLEGAL_USAGE

Illegal usage of CREATE_FILE.

For more details see CREATE_FILE_ILLEGAL_USAGE

CREATE_FILE_WRITE_UNAUTHORIZED

User is not authorized to write the file to the destination path <destination_path>.

CREATE_FOREIGN_SCHEMA_NOT_IMPLEMENTED_YET

The CREATE FOREIGN SCHEMA command is not implemented yet

CREATE_FOREIGN_TABLE_NOT_IMPLEMENTED_YET

The CREATE FOREIGN TABLE command is not implemented yet

CREATE_OR_REFRESH_MV_NOT_SUPPORTED

CREATE OR REFRESH MATERIALIZED VIEW is not supported. Use CREATE OR REPLACE MATERIALIZED VIEW instead.

CREATE_OR_REFRESH_MV_ST_ASYNC

Cannot CREATE OR REFRESH materialized views or streaming tables with ASYNC specified. Please remove ASYNC from the CREATE OR REFRESH statement or use REFRESH ASYNC to refresh existing materialized views or streaming tables asynchronously.

CREATE_PERMANENT_VIEW_WITHOUT_ALIAS

Not allowed to create the permanent view <name> without explicitly assigning an alias for the expression <attr>.

CREATE_TABLE_COLUMN_DESCRIPTOR_DUPLICATE

CREATE TABLE column <columnName> specifies descriptor "<optionName>" more than once, which is invalid.

CREATE_VIEW_COLUMN_ARITY_MISMATCH

SQLSTATE: 21S01

Cannot create view <viewName>, the reason is

For more details see CREATE_VIEW_COLUMN_ARITY_MISMATCH

CREATE_VIEW_WITH_IF_NOT_EXISTS_AND_REPLACE

CREATE VIEW <viewName> with both IF NOT EXISTS and REPLACE is not allowed.

CREDENTIAL_MISSING

Please provide credentials when creating or updating external locations.

CREDENTIAL_PURPOSE_MISMATCH

The credential <credentialName> has purpose <actualPurpose> but the purpose given in the command is <expectedPurpose>.

CROSS_CATALOG_SCHEMA_REFERENCE_NOT_SUPPORTED

DATATYPE_MISMATCH

Cannot resolve <sqlExpr> due to data type mismatch:

Data source '<provider>' not found. Please make sure the data source is registered.

DATA_SOURCE_NOT_FOUND

Failed to find the data source: <provider>. Make sure the provider name is correct and the package is properly registered and compatible with your Spark version.

DATA_SOURCE_OPTIONS_VALIDATION_FAILED

The <dataSource> data source option(s) validation failed.

For more details see DATA_SOURCE_OPTIONS_VALIDATION_FAILED

DATA_SOURCE_OPTION_CONTAINS_INVALID_CHARACTERS

Option <option> must not be empty and should not contain invalid characters, query strings, or parameters.

DATA_SOURCE_OPTION_IS_REQUIRED

Option <option> is required.

DATA_SOURCE_OPTION_NOT_ALLOWED_BY_CONNECTION

Option <optionName> is not allowed by connection <connectionName> and cannot be provided externally.

DATA_SOURCE_OPTION_VALUE_NOT_VALID

Expected schema: <expectedSchema>

DATA_SOURCE_URL_NOT_ALLOWED

SQLSTATE: 42KDB

JDBC URL is not allowed in data source options, please specify 'host', 'port', and 'database' options instead.

DATETIME_FIELD_OUT_OF_BOUNDS

<rangeMessage>.

For more details see DATETIME_FIELD_OUT_OF_BOUNDS

DATETIME_OVERFLOW

SQLSTATE: 22008

Datetime operation overflow: <operation>.

DBFS_DISABLED

Public DBFS root is disabled. Access is denied on path: <path>

DBFS_MOUNT_NOT_SUPPORTED

<methodName> is not supported on Standard access mode or Serverless compute. Switch to Dedicated access mode to use DBFS mounts.

Decimal precision <precision> exceeds max precision <maxPrecision>.

DEFAULT_DATABASE_NOT_EXISTS

Default database <defaultDatabase> does not exist, please create it first or change default database to <defaultDatabase>.

DEFAULT_FILE_NOT_FOUND

It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running 'REFRESH TABLE tableName' command in SQL or by recreating the Dataset/DataFrame involved. If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.

DEFAULT_PLACEMENT_INVALID

SQLSTATE: 42608

A DEFAULT keyword in a MERGE, INSERT, UPDATE, or SET VARIABLE command could not be directly assigned to a target column because it was part of an expression.

For example: UPDATE SET c1 = DEFAULT is allowed, but UPDATE T SET c1 = DEFAULT + 1 is not allowed.

DEFAULT_UNSUPPORTED

SQLSTATE: 42623

Failed to execute <statementType> command because DEFAULT values are not supported for target data source with table provider: "<dataSource>".

DEFINE_FLOW_ONCE_OPTION_NOT_SUPPORTED

Defining a one-time flow <flowName> with the 'once' option is not supported.

DESCRIBE_JSON_NOT_EXTENDED

DESCRIBE TABLE ... AS JSON only supported when [EXTENDED|FORMATTED] is specified.

For example: DESCRIBE EXTENDED <tableName> AS JSON is supported but DESCRIBE <tableName> AS JSON is not.

DIFFERENT_DELTA_TABLE_READ_BY_STREAMING_SOURCE

The streaming query was reading from an unexpected Delta table (id = '<newTableId>').

It used to read from another Delta table (id = '<oldTableId>') according to checkpoint.

This may happen when you changed the code to read from a new table or you deleted and

re-created a table. Please revert your change or delete your streaming query checkpoint

to restart from scratch.

DIRECTORY_ATOMIC_COMMIT_CONCURRENT_WRITE

Failed to commit because of a concurrent write to <path>. Retry the operation.

DIRECTORY_ATOMIC_COMMIT_MARKER_READ_FAILURE

Failed to read job commit marker: <marker>.

DISTINCT_WINDOW_FUNCTION_UNSUPPORTED

Distinct window functions are not supported: <windowExpr>.

DIVIDE_BY_ZERO

SQLSTATE: 22012

Cannot drop a <metadataType> with DROP <commandType>.

Use DROP <metadataTypeUpper> instead.

DROP_SCHEDULE_DOES_NOT_EXIST

Cannot drop SCHEDULE on a table without an existing schedule or trigger.

DR_TIMESTAMP_QUERY_NOT_SUPPORTED

Timestamp-based time travel is not supported on DR table '<tableName>'.

For more details see DR_TIMESTAMP_QUERY_NOT_SUPPORTED

DUPLICATED_CTE_NAMES

CTE definition can't have duplicate names: <duplicateNames>.

DUPLICATED_FIELD_NAME_IN_ARROW_STRUCT

SQLSTATE: 42713

Duplicated field names in Arrow Struct are not allowed, got <fieldNames>.

DUPLICATED_MAP_KEY

SQLSTATE: 23505

Duplicate map key <key> was found, please check the input data.

If you want to remove the duplicated keys, you can set <mapKeyDedupPolicy> to "LAST_WIN" so that the key inserted at last takes precedence.

DUPLICATED_METRICS_NAME

The metric name is not unique: <metricName>. The same name cannot be used for metrics with different results.

However multiple instances of metrics with with same result and name are allowed (for example, self-joins).

DUPLICATE_ASSIGNMENTS

The columns or variables <nameList> appear more than once as assignment targets.

DUPLICATE_CLAUSES

Found duplicate clauses: <clauseName>. Please, remove one of them.

DUPLICATE_CONDITION_IN_SCOPE

Found duplicate condition <condition> in the scope. Please, remove one of them.

DUPLICATE_EXCEPTION_HANDLER

Found duplicate handlers. Please, remove one of them.

For more details see DUPLICATE_EXCEPTION_HANDLER

DUPLICATE_FLOW_SQL_CONF

Found duplicate SQL conf for dataset '<datasetName>': '<key>' is defined by both '<flowName1>' and '<flowName2>'

DUPLICATE_GRAPH_ELEMENT

Found duplicate <graphElementType> '<graphElementName>'.

DUPLICATE_KEY

SQLSTATE: 23505

Found duplicate keys <keyColumn>.

DUPLICATE_PARTITION_TRANSFORM

Found duplicate column(s) <checkType>: <duplicateColumns>

DUPLICATE_ROUTINE_PARAMETER_ASSIGNMENT

Call to routine <routineName> is invalid because it includes multiple argument assignments to the same parameter name <parameterName>.

For more details see DUPLICATE_ROUTINE_PARAMETER_ASSIGNMENT

DUPLICATE_ROUTINE_PARAMETER_NAMES

Found duplicate name(s) in the parameter list of the user-defined routine <routineName>: <names>.

DUPLICATE_ROUTINE_RETURNS_COLUMNS

Found duplicate column(s) in the RETURNS clause column list of the user-defined routine <routineName>: <columns>.

DUPLICATE_SQL_PATH_ENTRY

SQLSTATE: 42732

Duplicate SQL path entry <pathEntry>. The session SQL path cannot contain the same namespace more than once (including after expanding shortcuts like DEFAULT_PATH or SYSTEM_PATH).

DUPLICATE_VARIABLE_NAME_INSIDE_DECLARE

Found duplicate variable <variableName> in the declare variable list. Please, remove one of them.

DYNAMIC_PARTITION_WRITE_PARTITION_NUM_LIMIT_EXCEEDED

SQLSTATE: 54054

Number of dynamic partitions created is <numWrittenParts>, which is more than <maxDynamicPartitions>. To solve this try to set <maxDynamicPartitionsKey> to at least <numWrittenParts>.

EMITTING_ROWS_OLDER_THAN_WATERMARK_NOT_ALLOWED

SQLSTATE: 42815

Previous node emitted a row with eventTime=<emittedRowEventTime> which is older than current_watermark_value=<currentWatermark>

This can lead to correctness issues in the stateful operators downstream in the execution pipeline.

Please correct the operator logic to emit rows after current global watermark value.

EMPTY_JSON_FIELD_VALUE

Failed to parse an empty string for data type <dataType>.

EMPTY_LOCAL_FILE_IN_STAGING_ACCESS_QUERY

Empty local file in staging <operation> query

EMPTY_PARTITION_COLUMN_NAME

Found an empty partition column name in the path segment '<columnSpec>'. Each partition directory must have a non-empty column name before the '=' sign (for example, 'col=value').

EMPTY_PARTITION_COLUMN_VALUE

Found an empty partition column value in the path segment '<columnSpec>'. Each partition directory must have a non-empty value after the '=' sign (for example, 'col=value').

EMPTY_SCHEMA_NOT_SUPPORTED_FOR_DATASOURCE

The <format> datasource does not support writing empty or nested empty schemas. Please make sure the data schema has at least one or more column(s).

ENCODER_NOT_FOUND

Not found an encoder of the type <typeName> to Spark SQL internal representation.

Consider to change the input type to one of supported at '<docroot>/sql-ref-datatypes.html'.

END_LABEL_WITHOUT_BEGIN_LABEL

End label <endLabel> can not exist without begin label.

END_OFFSET_HAS_GREATER_OFFSET_FOR_TOPIC_PARTITION_THAN_LATEST_WITH_TRIGGER_AVAILABLENOW

Some of partitions in Kafka topic(s) report available offset which is less than end offset during running query with Trigger.AvailableNow. The error could be transient - restart your query, and report if you still see the same issue.

latest offset: <latestOffset>, end offset: <endOffset>

END_OFFSET_HAS_GREATER_OFFSET_FOR_TOPIC_PARTITION_THAN_PREFETCHED

For Kafka data source with Trigger.AvailableNow, end offset should have lower or equal offset per each topic partition than pre-fetched offset. The error could be transient - restart your query, and report if you still see the same issue.

pre-fetched offset: <prefetchedOffset>, end offset: <endOffset>.

ENVIRONMENT_DOWNLOAD_CLOUD_FAILURE

Failed to download the Python notebook environment (hash: <hash>) for Spark session <id>. The cloud storage provider returned a server error. Retry the operation. <details>

ENVIRONMENT_DOWNLOAD_DEPENDENCY_FAILURE

Failed to download the Python notebook environment (hash: <hash>) for Spark session <id>. A temporary service error occurred. Retry the operation. Contact Databricks support if the issue persists. <details>

ENVIRONMENT_DOWNLOAD_USER_ERROR

SQLSTATE: KD00F

Failed to download the Python notebook environment (hash: <hash>) for Spark session <id>.

For more details see ENVIRONMENT_DOWNLOAD_USER_ERROR

ERROR_READING_AVRO_UNKNOWN_FINGERPRINT

SQLSTATE: KD00B

Error reading avro data -- encountered an unknown fingerprint: <fingerprint>, not sure what schema to use.

This could happen if you registered additional schemas after starting your spark context.

EVENT_LOG_EMPTY

The event log for <tableOrPipeline> has no schema and contains no events. Try again later after events are generated

EVENT_LOG_REQUIRES_SHARED_COMPUTE

Cannot query event logs from an Assigned or No Isolation Shared cluster, please use a Shared cluster or a Databricks SQL warehouse instead.

EVENT_LOG_TVF_UNSUPPORTED_FOR_PIPELINE

The EVENT_LOG Table-Valued Function is not supported for pipelines using the 'schema' field or pipelines publishing to default storage.

To query the event log, publish it to the metastore by specifying the event_log field in the pipeline settings.

For more information, see the Monitor pipelines documentation: https://docs.databricks.com/aws/en/ldp/observability

EVENT_LOG_TVF_UNSUPPORTED_IN_TEST

The event_log TVF is not supported inside a Spark Declarative Pipelines on Lakeflow test. The test run event log is in test_pipeline.run().event_log or test_pipeline.event_log.

EVENT_LOG_UNAVAILABLE

No event logs available for <tableOrPipeline>. Please try again later after events are generated

EVENT_LOG_UNSUPPORTED_TABLE_TYPE

The table type of <tableIdentifier> is <tableType>.

Querying event logs only supports materialized views, streaming tables, or Spark Declarative Pipelines on Lakeflow

EVENT_TIME_IS_NOT_ON_TIMESTAMP_TYPE

The event time <eventName> has the invalid type <eventType>, but expected "TIMESTAMP".

EVENT_TIME_MUST_BE_TOP_LEVEL_COLUMN

The event time in withWatermark must be a top-level column, but '<eventExpr>' is a nested field. To use it, alias it to a top-level column in a select before withWatermark.

EXCEED_LIMIT_LENGTH

SQLSTATE: 54006

Exceeds char/varchar type length limitation: <limit>.

EXCEL_DATA_SOURCE_NOT_ENABLED

Excel data source is not enabled in this cluster.

EXCEL_DATA_WRITER_NOT_ENABLED

Excel file format writes are not supported.

EXCEL_FILE_ERROR

Error processing Excel file '<filePath>'.

For more details see EXCEL_FILE_ERROR

EXCEL_INVALID_READ_OPTION_VALUE

Invalid read option value for Excel data source.

For more details see EXCEL_INVALID_READ_OPTION_VALUE

EXCEL_INVALID_WRITE_OPTION_VALUE

The Excel data source does not support the value '<value>' for the write option '<option>'.

For more details see EXCEL_INVALID_WRITE_OPTION_VALUE

EXCEL_INVALID_WRITE_SCHEMA

The Excel data source does not support the schema '<schema>' for writes.

<hint>

EXCEL_PARSING_ERROR

Error parsing Excel data.

For more details see EXCEL_PARSING_ERROR

EXCEL_THREAD_WAIT_TIMEOUT

Excel thread wait exceeded <timeoutMs>ms timeout.

EXCEL_UNSUPPORTED_WRITE_OPTION

The Excel data source does not support the write option '<option>'.

<hint>

EXCEPT_NESTED_COLUMN_INVALID_TYPE

SQLSTATE: 428H2

EXCEPT column <columnName> was resolved and expected to be StructType, but found type <dataType>.

EXCEPT_OVERLAPPING_COLUMNS

Columns in an EXCEPT list must be distinct and non-overlapping, but got (<columns>).

EXCEPT_RESOLVED_COLUMNS_WITHOUT_MATCH

EXCEPT columns [<exceptColumns>] were resolved, but do not match any of the columns [<expandedColumns>] from the star expansion.

EXCEPT_UNRESOLVED_COLUMN_IN_STRUCT_EXPANSION

'<operation>' expects a table but <viewName> is a view.

For more details see EXPECT_TABLE_NOT_VIEW

EXPECT_VIEW_NOT_TABLE

The table <tableName> does not support <operation>.

For more details see EXPECT_VIEW_NOT_TABLE

EXPLODE_EMBEDDED_ARRAY_CONFLICTING_OPTION

The 'explodeEmbeddedArray' DataFrame API reader option is mutually exclusive with the '<option>' DataFrame API option.

Please remove one of them and then retry the DataFrame operation again.

EXPLODE_EMBEDDED_ARRAY_UNSUPPORTED_USAGE

The 'explodeEmbeddedArray' option can only be used when reading JSON files. It is not supported in <usage>.

EXPRESSION_DECODING_FAILED

Failed to decode a row to a value of the expressions: <expressions>.

EXPRESSION_ENCODING_FAILED

Failed to encode a value of the expressions: <expressions> to a row.

EXPRESSION_TRANSLATION_TO_V2_IS_NOT_SUPPORTED

Expression <expr> cannot be translated to v2 expression.

EXPRESSION_TYPE_IS_NOT_ORDERABLE

SQLSTATE: 42822

Column expression <expr> cannot be sorted because its type <exprType> is not orderable.

EXTENDED_METADATA_FETCH_FAILURE

Failed to fetch extended metadata for file <path>.

For more details see EXTENDED_METADATA_FETCH_FAILURE

EXTERNAL_METADATA_UNRESOLVED_PROJECTION

The projection query '<query>' can't be resolved on schema: <schemaTreeString>

EXTERNAL_METADATA_UNSUPPORTED_SOURCE

External Metadata doesn't support source:

For more details see EXTERNAL_METADATA_UNSUPPORTED_SOURCE

EXTERNAL_METASTORE_CLIENT_ERROR

For more details see FAILED_IRC

FAILED_JDBC

SQLSTATE: HV000

Failed JDBC <url> on the operation:

For more details see FAILED_JDBC

FAILED_PARSE_STRUCT_TYPE

Failed parsing struct: <raw>.

FAILED_READ_FILE

SQLSTATE: KD001

Error while reading file <path>.

For more details see FAILED_READ_FILE

FAILED_REGISTER_CLASS_WITH_KRYO

Failed to register classes with Kryo.

FAILED_RENAME_PATH

Failed to rename <sourcePath> to <targetPath> as destination already exists.

FAILED_RENAME_TEMP_FILE

Failed to rename temp file <srcPath> to <dstPath> as FileSystem.rename returned false.

FAILED_ROW_TO_JSON

Failed to convert the row value <value> of the class <class> to the target SQL type <sqlType> in the JSON format.

FAILED_TO_CREATE_PLAN_FOR_DIRECT_QUERY

Failed to create plan for direct query on files: <dataSourceType>

FAILED_TO_LOAD_ROUTINE

Failed to load routine <routineName>.

FAILED_TO_PARSE_TOO_COMPLEX

SQLSTATE: 54001

The statement, including potential SQL functions and referenced views, was too complex to parse.

To mitigate this error divide the statement into multiple, less complex chunks.

FAILED_UPDATE_VIEW_SCHEMA

The schema of view <viewName> is out of sync with its query output. Queries on this view will fail until the schema is updated.

Because the view is created <schemaMode>, an automatic sync was attempted but the catalog failed to apply the update.

Stored view schema: <existingSchema>

Query output schema: <newSchema>

To resolve this, ALTER the view schema manually or ask an administrator to do so. Alternatively, consider running ALTER VIEW <viewName> WITH SCHEMA COMPENSATION, which casts the query output to match the stored view schema at query time and does not require updating the catalog.

FANOUT_INVALID_TABLE_EXPR

FGAC_TIME_TRAVEL_NOT_SUPPORTED

Cannot time travel to the specified version or timestamp of this table.

For more details see FGAC_TIME_TRAVEL_NOT_SUPPORTED

FGAC_TIME_TRAVEL_SCHEMA_MISMATCH

Cannot time travel to this table version because its schema is incompatible with the current schema required for row filters or column masks.

For more details see FGAC_TIME_TRAVEL_SCHEMA_MISMATCH

FIELD_ALREADY_EXISTS

Cannot <op> column, because <fieldNames> already exists in <struct>.

FIELD_NOT_FOUND

No such struct field <fieldName> in <fields>.

FILE_DATA_SOURCE_SCHEMA_MISMATCH

The schema provided to the file reference data source does not match the expected schema.

Expected schema: <expectedSchema>

Provided schema: <providedSchema>

Remove the explicit schema or update it to match the expected schema.

FILE_IN_STAGING_PATH_ALREADY_EXISTS

File in staging path <path> already exists but OVERWRITE is not set

FILE_SOURCE_CONNECTOR_FAIL_TO_RETRIEVE_ACCESS_TOKEN

Failed to retrieve access token for <source> connector. Please verify the UC connection is valid and up-to-date.

FILE_SOURCE_CONNECTOR_GDRIVE_INVALID_PATH

SQLSTATE: 22K04

The path <path> is not a valid GDrive path.

For more details see FILE_SOURCE_CONNECTOR_GDRIVE_INVALID_PATH

FILE_SOURCE_CONNECTOR_INVALID_GDRIVE_SCOPE

Unsupported Google Drive scope '<scope>'. Supported values are: <validScopes>.

FILE_SOURCE_CONNECTOR_INVALID_URL

SQLSTATE: 42KDB

The provided path is not a valid <source> URL. Use a <source> web URL with a Unity Catalog connection specified via the databricks.connection option.

FILE_SOURCE_CONNECTOR_MISSING_UC_CONNECTION

SQLSTATE: 08003

Reading data from <path> requires a Unity Catalog connection. Specify one using the option 'connection =>' when using 'read_files' or the DataFrame reader option 'databricks.connection' when using DataFrames.

FILE_SOURCE_CONNECTOR_ONEDRIVE_INVALID_PATH

SQLSTATE: 22K04

The path <path> is not a valid OneDrive path.

For more details see FILE_SOURCE_CONNECTOR_ONEDRIVE_INVALID_PATH

FILE_SOURCE_CONNECTOR_SHAREPOINT_INVALID_PATH

SQLSTATE: 22K04

The path <path> is not a valid SharePoint path.

For more details see FILE_SOURCE_CONNECTOR_SHAREPOINT_INVALID_PATH

FILE_TYPE_CONFLICTING_MODE_ON_SHARED_SOURCE

Source expression '<sourceAttr>' is being written to separate MANAGED and EXTERNAL columns. Duplicate this expression and assign each copy separately.

FILE_TYPE_FILESPACE_PROPERTY_IMMUTABLE

Cannot modify the 'databricks.filespace-preview' table property on an existing table.

For more details see FILE_TYPE_FILESPACE_PROPERTY_IMMUTABLE

FILE_TYPE_IN_ROUTINE_SIGNATURE_UNSUPPORTED_QUALIFIER

The FILE type in <routineType> <routineName> does not support MANAGED or EXTERNAL qualifiers. Use FILE without a qualifier.

FILE_TYPE_MISSING_FILESPACE

FOREIGN_TABLE_CONVERSION_UNSUPPORTED

Table is not eligible for upgrade from UC Foreign to UC External. Reason:

For more details see FOREIGN_TABLE_CONVERSION_UNSUPPORTED

FOREIGN_VIEW_CONVERSION_UNSUPPORTED

Object <objectName> is not eligible for conversion to a UC Managed view. Reason:

For more details see FOREIGN_VIEW_CONVERSION_UNSUPPORTED

FROM_JSON_CONFLICTING_SCHEMA_UPDATES

from_json inference encountered conflicting schema updates at: <location>

FROM_JSON_CORRUPT_RECORD_COLUMN_IN_SCHEMA

from_json found columnNameOfCorruptRecord (<columnNameOfCorruptRecord>) present

in a JSON object and can no longer proceed. Please configure a different value for

the option 'columnNameOfCorruptRecord'.

FROM_JSON_CORRUPT_SCHEMA

from_json inference could not read the schema stored at: <location>

FROM_JSON_INFERENCE_FAILED

from_json was unable to infer the schema. Please provide one instead.

FROM_JSON_INFERENCE_NOT_SUPPORTED

from_json inference is only supported when defining streaming tables

FROM_JSON_INVALID_CONFIGURATION

from_json configuration is invalid:

For more details see FROM_JSON_INVALID_CONFIGURATION

FROM_JSON_SCHEMA_EVOLUTION_FAILED

SQLSTATE: 22KD3

from_json could not evolve from <old> to <new>

FUNCTION_PARAMETERS_MUST_BE_NAMED

SQLSTATE: 07001

The function <function> requires named parameters. Parameters missing names: <exprs>. Please update the function call to add names for all parameters, for example, <function>(param_name => ...).

GENERATED_COLUMN_WITH_DEFAULT_VALUE

SQLSTATE: 42623

A column cannot have both a default value and a generation expression but column <colName> has default value: (<defaultValue>) and generation expression: (<genExpr>).

GEO_ENCODER_SRID_MISMATCH_ERROR

Failed to encode <type> value because provided SRID <valueSrid> of a value to encode does not match type SRID: <typeSrid>.

GET_CLUSTER_STARTUP_STEPS_FUNCTION_NOT_ALLOWED

Function get_cluster_startup_steps() is only available on PAL-pipeline test images with ENABLE_PAL_TESTING=true.

GET_DRIVER_STARTUP_EVENTS_FUNCTION_NOT_ALLOWED

Function get_driver_startup_events() is only available on PAL-pipeline test images with ENABLE_PAL_TESTING=true.

GET_TABLES_BY_TYPE_UNSUPPORTED_BY_HIVE_VERSION

Hive 2.2 and lower versions don't support getTablesByType. Please use Hive 2.3 or higher version.

GET_WARMUP_TRACING_FAILED

Failed to get warmup tracing. Cause: <cause>.

GET_WARMUP_TRACING_FUNCTION_NOT_ALLOWED

Function get_warmup_tracing() not allowed.

GRAPHITE_SINK_INVALID_PROTOCOL

Invalid Graphite protocol: <protocol>.

GRAPHITE_SINK_PROPERTY_MISSING

Graphite sink requires '<property>' property.

GROUPING_COLUMN_MISMATCH

Column of grouping (<grouping>) can't be found in grouping columns <groupingColumns>.

GROUPING_ID_COLUMN_MISMATCH

Columns of grouping_id (<groupingIdColumn>) does not match grouping columns (<groupByColumns>).

GROUPING_SIZE_LIMIT_EXCEEDED

Grouping sets size cannot be greater than <maxSize>.

GROUP_BY_AGGREGATE

Aggregate functions are not allowed in GROUP BY, but found <sqlExpr>.

For more details see GROUP_BY_AGGREGATE

GROUP_BY_POS_AGGREGATE

GROUP BY <index> refers to an expression <aggExpr> that contains an aggregate function. Aggregate functions are not allowed in GROUP BY.

GROUP_BY_POS_OUT_OF_RANGE

SQLSTATE: 42805

GROUP BY position <index> is not in select list (valid range is [1, <size>]).

GROUP_EXPRESSION_TYPE_IS_NOT_ORDERABLE

SQLSTATE: 42822

The expression <sqlExpr> cannot be used as a grouping expression because its data type <dataType> is not an orderable data type.

HDFS_HTTP_ERROR

SQLSTATE: KD00F

When attempting to read from HDFS, HTTP request failed.

For more details see HDFS_HTTP_ERROR

HINT_UNSUPPORTED_FOR_JDBC_DIALECT

SQLSTATE: 42822

The option hint is not supported for <jdbcDialect> in JDBC data source. Supported dialects are MySQLDialect, OracleDialect and DatabricksDialect.

HIVE_METASTORE_INVALID_PLACEHOLDER_PATH

The query or command failed to execute because the 'spark.databricks.hive.metastore.tablePlaceholderPath' configuration provided an invalid Hive Metastore table placeholder path. Please update this configuration with a new value to provide a valid path and then re-run the query or command again.

HIVE_METASTORE_TABLE_PLACEHOLDER_PATH_NOT_SET

The query or command failed because the Hive Metastore table placeholder path is not set, which is required when schema location is on DBFS, and table location is an object/file. Please set spark.databricks.hive.metastore.tablePlaceholderPath to a path you have access to and then re-run the query or command again.

HLL_INVALID_INPUT_SKETCH_BUFFER

Invalid call to <function>; only valid HLL sketch buffers are supported as inputs (such as those produced by the hll_sketch_agg function).

HLL_INVALID_LG_K

Invalid call to <function>; the lgConfigK value must be between <min> and <max>, inclusive: <value>.

HLL_K_MUST_BE_CONSTANT

Invalid call to <function>; the K value must be a constant value, but got a non-constant expression.

HLL_UNION_DIFFERENT_LG_K

Sketches have different lgConfigK values: <left> and <right>. Set the allowDifferentLgConfigK parameter to true to call <function> with different lgConfigK values.

HMS_FEDERATION_SHALLOW_CLONE_NOT_FOUND_IN_UC

The shallow clone path '<path>' could not be resolved to a table in Unity Catalog. Please ensure the table exists and is federated to Unity Catalog.

HYBRID_ANALYZER_EXCEPTION

An failure occurred when attempting to resolve a query or command with both the legacy fixed-point analyzer as well as the single-pass resolver.

For more details see HYBRID_ANALYZER_EXCEPTION

IDENTIFIER_TOO_MANY_NAME_PARTS

<identifier> is not a valid identifier as it has more than <limit> name parts.

IDENTITY_COLUMNS_DUPLICATED_SEQUENCE_GENERATOR_OPTION

Duplicated IDENTITY column sequence generator option: <sequenceGeneratorOption>.

IDENTITY_COLUMNS_ILLEGAL_STEP

SQLSTATE: 42611

IDENTITY column step cannot be 0.

IDENTITY_COLUMNS_UNSUPPORTED_DATA_TYPE

SQLSTATE: 428H2

DataType <dataType> is not supported for IDENTITY columns.

ILLEGAL_DAY_OF_WEEK

SQLSTATE: 22009

Illegal input for day of week: <string>.

ILLEGAL_SEQUENCE_BOUNDARIES

The step <step> is not valid for the sequence boundaries <start> to <stop>. A positive step requires start <= stop, a negative step requires start >= stop, and a zero step requires start == stop.

ILLEGAL_STATE_STORE_VALUE

Illegal value provided to the State Store

For more details see ILLEGAL_STATE_STORE_VALUE

INAPPROPRIATE_URI_SCHEME_OF_CONNECTION_OPTION

Connection can't be created due to inappropriate scheme of URI <uri> provided for the connection option '<option>'.

Allowed scheme(s): <allowedSchemes>.

Please add a scheme if it is not present in the URI, or specify a scheme from the allowed values.

INCOMPARABLE_PIVOT_COLUMN

SQLSTATE: 42818

Invalid pivot column <columnName>. Pivot columns must be comparable.

INCOMPATIBLE_BATCH_VIEW_READ

View <datasetIdentifier> is a batch view and must be referenced using SparkSession#read. This check can be disabled by setting Spark conf pipelines.incompatibleViewCheck.enabled = false.

INCOMPATIBLE_COLUMN_CHANGES_AFTER_VIEW_WITH_PLAN_CREATION

SQLSTATE: 51024

View <viewName> plan references table <tableName> whose <colType> columns changed since the view plan was initially captured.

Column changes:

<errors>

This indicates the table has evolved and the view based on the plan must be recreated.

INCOMPATIBLE_COLUMN_TYPE

SQLSTATE: 42825

<operator> can only be performed on tables with compatible column types. The <columnOrdinalNumber> column of the <tableOrdinalNumber> table is <dataType1> type which is not compatible with <dataType2> at the same column of the first table.<hint>.

INCOMPATIBLE_DATASOURCE_REGISTER

Detected an incompatible DataSourceRegister. Please remove the incompatible library from classpath or upgrade it. Error: <message>

INCOMPATIBLE_DATA_FOR_TABLE

Cannot write incompatible data for the table <tableName>:

For more details see INCOMPATIBLE_DATA_FOR_TABLE

INCOMPATIBLE_JOIN_TYPES

The join types <joinType1> and <joinType2> are incompatible.

INCOMPATIBLE_STREAMING_VIEW_READ

View <datasetIdentifier> is a streaming view and must be referenced using SparkSession#readStream. This check can be disabled by setting Spark conf pipelines.incompatibleViewCheck.enabled = false.

INCOMPATIBLE_TABLE_CHANGE_AFTER_ANALYSIS

SQLSTATE: 51024

Detected incompatible changes to table <tableName> after DataFrame/Dataset has been resolved and analyzed, meaning the underlying plan is out of sync. Please, re-create DataFrame/Dataset before attempting to execute the query again.

For more details see INCOMPATIBLE_TABLE_CHANGE_AFTER_ANALYSIS

INCOMPATIBLE_VIEW_SCHEMA_CHANGE

SQLSTATE: 51024

The SQL query of view <viewName> has an incompatible schema change and column <colName> cannot be resolved. Expected <expectedNum> columns named <colName> but got <actualCols>.

Please try to re-create the view by running: <suggestion>.

INCOMPLETE_TYPE_DEFINITION

SQLSTATE: 42K01

Incomplete complex type:

For more details see INCOMPLETE_TYPE_DEFINITION

INCOMPLETE_UC_SECRET_IDENTIFIER

UC Secret reference requires a fully qualified 3-part identifier (catalog.schema.name). Missing: <missingPart>.

INCONSISTENT_BEHAVIOR_CROSS_VERSION

To convert a table to a managed table, use the ALTER TABLE <tableName> SET MANAGED command.

For more information, see https://docs.databricks.com/aws/en/tables/convert-external-managed.

INDEX_REQUIRES_PREDICTIVE_OPTIMIZATION

INSERT_PARTITION_COLUMN_ARITY_MISMATCH

SQLSTATE: 21S01

Cannot write to '<tableName>', <reason>:

Table columns: <tableColumns>.

INSERT_REPLACE_USING_INVALID_SET_OF_COLUMNS

Table must be partitioned and all specified columns must represent the full set of the partition columns of the table.

The following columns are not partition columns: <nonPartitionColumns>

The following partitions columns are missing: <missingPartitionsColumns>

INSERT_REPLACE_USING_NOT_ENABLED

INSERT INTO ... REPLACE USING is not enabled. Set 'spark.sql.insertIntoReplaceUsing.enabled' to true to enable it.

INSERT_REPLACE_WHERE_COLUMN_LIST_NOT_ENABLED

The INSERT INTO ... (column_list) REPLACE WHERE feature is not enabled. Contact your Databricks representative to enable.

INSERT_REPLACE_WHERE_TABLE_ALIAS_NOT_ALLOWED

Table alias is not allowed with INSERT INTO ... REPLACE WHERE because the WHERE condition is evaluated against the target table directly.

Use INSERT INTO ... REPLACE ON if you need to reference the target table via an alias.

INSUFFICIENT_PERMISSIONS

User cannot <action> on <securableName> because of permissions on underlying securables:

<underlyingReport>

INTERNAL_TABLE_FUNCTION_NOT_AVAILABLE

Internal table-valued functions are not available to the current caller.

INTERVAL_ARITHMETIC_OVERFLOW

SQLSTATE: 22015

Integer overflow while operating with intervals.

For more details see INTERVAL_ARITHMETIC_OVERFLOW

INTERVAL_DIVIDED_BY_ZERO

SQLSTATE: 22012

Division by zero. Use try_divide to tolerate divisor being 0 and return NULL instead.

INVALID_AGGREGATE_FILTER

The FILTER expression <filterExpr> in an aggregate function is invalid.

For more details see INVALID_AGGREGATE_FILTER

INVALID_AGNOSTIC_ENCODER

SQLSTATE: 42001

Found an invalid agnostic encoder. Expects an instance of AgnosticEncoder but got <encoderType>. For more information consult '<docroot>/api/java/index.html?org/apache/spark/sql/Encoder.html'.

INVALID_ARRAY_INDEX

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use the SQL function get() to tolerate accessing element at invalid index and return NULL instead.

For more details see INVALID_ARRAY_INDEX

INVALID_ARRAY_INDEX_IN_ELEMENT_AT

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use try_element_at to tolerate accessing element at invalid index and return NULL instead.

For more details see INVALID_ARRAY_INDEX_IN_ELEMENT_AT

INVALID_ARTIFACT_PATH

Artifact with name <name> is invalid. The name must be a relative path and cannot reference parent/sibling/nephew directories.

INVALID_ATTRIBUTE_NAME_SYNTAX

Syntax error in the attribute name: <name>. Check that backticks appear in pairs, a quoted string is a complete name part and use a backtick only inside quoted name parts.

INVALID_AUTO_TTL_EXPIRE_IN_DAYS

The number of days specified for Auto-TTL must be a non-negative integer.

INVALID_AWS_AUTHENTICATION

Please choose exactly one of the following authentication methods:

Provide the name of your Databricks service credential (<serviceCredential>) (as a spark stream option or as a cluster environment variable).
Provide both the AWS AccessKey (<awsAccessKey>) and SecretAccessKey (<awsSecretKey>) to use AWS keys.
Provide neither the AWS keys nor a Databricks service credential to use the default AWS credential provider chain for Kinesis authentication.

INVALID_AWS_AUTHENTICATION_EXPLICIT_OPTIONS

Please provide either the name of your Databricks service credential (<serviceCredential>)

OR both <awsAccessKey> and <awsSecretKey>

INVALID_BITMAP_POSITION

The 0-indexed bitmap position <bitPosition> is out of bounds. The bitmap has <bitmapNumBits> bits (<bitmapNumBytes> bytes).

INVALID_BOOLEAN_STATEMENT

Boolean statement is expected in the condition, but <invalidStatement> was found.

INVALID_BOUNDARY

The boundary <boundary> is invalid: <invalidValue>.

For more details see INVALID_BOUNDARY

INVALID_BUCKET_COLUMN_DATA_TYPE

Cannot use <type> for bucket column. Collated data types are not supported for bucketing.

INVALID_BUCKET_COUNT

Number of buckets should be greater than 0 but less than or equal to bucketing.maxBuckets (<bucketingMaxBuckets>). Got <numBuckets>.

INVALID_BUCKET_FILE

Invalid bucket file: <path>.

INVALID_BYTE_STRING

SQLSTATE: 22P03

The expected format is ByteString, but was <unsupported> (<class>).

INVALID_CDC_OPTION

Invalid Change Data Capture (CDC) option.

For more details see INVALID_CDC_OPTION

INVALID_CHANGELOG_SCHEMA

The Change Data Capture (CDC) schema returned by connector <changelogName> is invalid.

For more details see INVALID_CHANGELOG_SCHEMA

INVALID_CIDR_BLOCK

The function <functionName> received an invalid CIDR block: <value>.

INVALID_CLONE_SESSION_REQUEST

INVALID_DBFS_MOUNT

SQLSTATE: 42KDL

DBFS Mount can't be accessed.

For more details see INVALID_DBFS_MOUNT

INVALID_DBSQL_CONFIG

<confValue> is not supported for SQL configuration key <confKey>

INVALID_DECFLOAT_ROUND_MODE

<value> is not a valid DECFLOAT rounding mode. Valid modes: <validModes>.

INVALID_DEFAULT_VALUE

SQLSTATE: 42623

Failed to execute <statement> command because the destination column or variable <colName> has a DEFAULT value <defaultValue>,

For more details see INVALID_DEFAULT_VALUE

INVALID_DELIMITER_VALUE

Invalid value for delimiter.

For more details see INVALID_DELIMITER_VALUE

INVALID_DEST_CATALOG

Destination catalog of the SYNC command must be within Unity Catalog. Found <catalog>.

INVALID_DRIVER_MEMORY

System memory <systemMemory> must be at least <minSystemMemory>.

Please increase heap size using the --driver-memory option or "<config>" in Spark configuration.

INVALID_DROP_TABLE_OPTIONS

Cannot specify both PURGE and FORCE options in DROP TABLE command. Use either PURGE or FORCE, but not both.

INVALID_DYNAMIC_OPTIONS

SQLSTATE: 42K10

Options passed <option_list> are forbidden for foreign table <table_name>.

INVALID_EMPTY_LOCATION

The location name cannot be empty string, but <location> was given.

INVALID_ENVIRONMENT_SETTINGS_DEPENDENCIES

The environment settings dependencies parameter is missing or it couldn't be parsed to a list of strings. Expected format: ["dep1", "dep2"]

INVALID_ENVIRONMENT_SETTINGS_ENVIRONMENT_VERSION

This runtime version does not support an environment version for data sources. Value: <environmentVersion>.

INVALID_ERROR_CONDITION_DECLARATION

SQLSTATE: 42K0R

Invalid condition declaration.

For more details see INVALID_ERROR_CONDITION_DECLARATION

INVALID_ESC

Found an invalid escape string: <invalidEscape>. The escape string must contain only one character.

INVALID_ESCAPE_CHAR

EscapeChar should be a string literal of length one, but got <sqlExpr>.

INVALID_EXECUTOR_MEMORY

Executor memory <executorMemory> must be at least <minSystemMemory>.

Please increase executor memory using the --executor-memory option or "<config>" in Spark configuration.

INVALID_EXPLODE_EMBEDDED_ARRAY_SCHEMA

User specified schema <schema> is invalid when the explodeEmbeddedArray option is enabled. The schema must either be a variant field, or a variant field plus a corrupt column field.

INVALID_EXPRESSION_ENCODER

SQLSTATE: 42001

Found an invalid expression encoder. Expects an instance of ExpressionEncoder but got <encoderType>. For more information consult '<docroot>/api/java/index.html?org/apache/spark/sql/Encoder.html'.

INVALID_EXPR_TYPE_FOR_QUERY_EXECUTE_IMMEDIATE

Expression type must be string type but got <exprType>.

INVALID_EXTERNAL_TYPE

SQLSTATE: 42K0N

The external type <externalType> is not valid for the type <type> at the expression <expr>.

INVALID_EXTERNAL_VALUE

SQLSTATE: 42K0N

The value (<other>) of the type (<otherClass>) cannot be converted to the <dataType> type.

INVALID_EXTRACT_BASE_FIELD_TYPE

Can't extract a value from <base>. Need a complex type [STRUCT, ARRAY, MAP] but got <other>.

INVALID_EXTRACT_FIELD

Cannot extract <field> from <expr>.

INVALID_EXTRACT_FIELD_TYPE

Field name should be a non-null string literal, but it's <extraction>.

INVALID_FIELD_NAME

Field name <fieldName> is invalid: <path> is not a struct.

INVALID_FLOW_QUERY_TYPE

Flow <flowIdentifier> returns an invalid relation type.

For more details see INVALID_FLOW_QUERY_TYPE

INVALID_FORMAT

The format is invalid: <format>.

For more details see INVALID_FORMAT

INVALID_FRACTION_OF_SECOND

Valid range for seconds is [0, 60] (inclusive), but the provided value is <secAndMicros>. To avoid this error, use try_make_timestamp, which returns NULL on error.

If you do not want to use the session default timestamp version of this function, use try_make_timestamp_ntz or try_make_timestamp_ltz.

INVALID_GET_DIAGNOSTICS_USAGE

SQLSTATE: 42612

Invalid usage of GET DIAGNOSTICS statement.

For more details see INVALID_GET_DIAGNOSTICS_USAGE

INVALID_GET_DIAGNOSTICS_USAGE_CONDITION_NUMBER_MUST_BE_ONE

SQLSTATE: 35000

Invalid usage of GET DIAGNOSTICS statement. The only supported value for a condition number in the GET DIAGNOSTICS statement is 1.

INVALID_HANDLE

SQLSTATE: HY000

The handle <handle> is invalid.

For more details see INVALID_HANDLE

INVALID_HANDLER_DECLARATION

SQLSTATE: 42K0Q

Invalid handler declaration.

For more details see INVALID_HANDLER_DECLARATION

INVALID_HTTP_REQUEST_METHOD

The input parameter: method, value: <paramValue> is not a valid parameter for http_request because it is not a valid HTTP method.

INVALID_HTTP_REQUEST_PATH

The input parameter: path, value: <paramValue> is not a valid parameter for http_request because path traversal is not allowed.

INVALID_IDENTIFIER

The unquoted identifier <ident> is invalid and must be back quoted as: <ident>.

Unquoted identifiers can only contain ASCII letters ('a' - 'z', 'A' - 'Z'), digits ('0' - '9'), and underbar ('_').

Unquoted identifiers must also not start with a digit.

Different data sources and meta stores may impose additional restrictions on valid identifiers.

INVALID_INDEX_OF_ZERO

The index 0 is invalid. An index shall be either < 0 or > 0 (the first element has index 1).

INVALID_INLINE_TABLE

Invalid inline table.

For more details see INVALID_INLINE_TABLE

INVALID_INTERVAL_FORMAT

Error parsing '<input>' to interval. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format.

For more details see INVALID_INTERVAL_FORMAT

INVALID_INTERVAL_WITH_MICROSECONDS_ADDITION

Cannot add an interval to a date because its microseconds part is not 0. To resolve this, cast the input date to a timestamp, which supports the addition of intervals with non-zero microseconds.

INVALID_IP_ADDRESS

The function <functionName> received an invalid IP address: <value>.

INVALID_IP_ADDRESS_OR_CIDR_BLOCK

The function <functionName> received an invalid IP address or CIDR block: <value>.

INVALID_JAVA_IDENTIFIER_AS_FIELD_NAME

INVALID_LABEL_USAGE

The usage of the label <labelName> is invalid.

For more details see INVALID_LABEL_USAGE

INVALID_LAMBDA_FUNCTION_CALL

SQLSTATE: 42K0D

Invalid lambda function call.

For more details see INVALID_LAMBDA_FUNCTION_CALL

INVALID_LATERAL_JOIN_TYPE

The <joinType> JOIN with LATERAL correlation is not allowed because an OUTER subquery cannot correlate to its join partner. Remove the LATERAL correlation or use an INNER JOIN, or LEFT OUTER JOIN instead.

INVALID_LIMIT_LIKE_EXPRESSION

The limit like expression <expr> is invalid.

For more details see INVALID_LIMIT_LIKE_EXPRESSION

INVALID_LINE_SEPARATOR

Invalid line separator configuration.

For more details see INVALID_LINE_SEPARATOR

INVALID_LOCATION_URI

Invalid location URI <location> in the Hive Metastore.

For more details see INVALID_LOCATION_URI

INVALID_LOG_VERSION

UnsupportedLogVersion.

For more details see INVALID_LOG_VERSION

INVALID_METRIC_VIEW_YAML

Failed to parse metric view YAML: <message>

INVALID_NAME_IN_USE_COMMAND

Invalid name '<name>' in <command> command. Reason: <reason>

INVALID_NON_ABSOLUTE_PATH

The provided non absolute path <path> can not be qualified. Please update the path to be a valid dbfs mount location.

INVALID_NON_DETERMINISTIC_EXPRESSIONS

The operator expects a deterministic expression, but the actual expression is <sqlExprs>.

INVALID_NUMERIC_LITERAL_RANGE

Numeric literal <rawStrippedQualifier> is outside the valid range for <typeName> with minimum value of <minValue> and maximum value of <maxValue>. Please adjust the value accordingly.

INVALID_OBSERVED_METRICS

Invalid observed metrics.

For more details see INVALID_OBSERVED_METRICS

INVALID_OPTIONS

Invalid options:

For more details see INVALID_OPTIONS

INVALID_PANDAS_UDF_PLACEMENT

The group aggregate pandas UDF <functionList> cannot be invoked together with as other, non-pandas aggregate functions.

INVALID_PARAMETER_MARKER_VALUE

An invalid parameter mapping was provided:

For more details see INVALID_PARAMETER_MARKER_VALUE

INVALID_PARAMETER_VALUE

The value of parameter(s) <parameter> in <functionName> is invalid:

For more details see INVALID_PARAMETER_VALUE

INVALID_PARTITION_COLUMN_DATA_TYPE

Cannot use <type> for partition column.

INVALID_PARTITION_OPERATION

The partition command is invalid.

For more details see INVALID_PARTITION_OPERATION

INVALID_PARTITION_SPEC

Partition spec is invalid. <details>.

INVALID_PARTITION_VALUE

Failed to cast value <value> to data type <dataType> for partition column <columnName>. Ensure the value matches the expected data type for this partition column.

INVALID_PATH_STRING

The path '<path>' is not a valid file system path. Reason: <reason>

INVALID_PIPELINE_ID

Pipeline id <pipelineId> is not valid.

A pipeline id should be a UUID in the format of 'xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx'

INVALID_PRIVILEGE

SQLSTATE: 42852

Privilege <privilege> is not valid for <securable>.

INVALID_PROPERTY_KEY

<key> is an invalid property key, please use quotes, for example, SET <key>=<value>.

INVALID_PROPERTY_VALUE

<value> is an invalid property value, please use quotes, for example, SET <key>=<value>

INVALID_QUALIFIED_COLUMN_NAME

The column name <columnName> is invalid because it is not qualified with a table name or consists of more than 4 name parts.

INVALID_QUERY_MIXED_QUERY_PARAMETERS

Parameterized query must either use positional, or named parameters, but not both.

INVALID_REBALANCE_BY_SIZE_HINT_PARAMETER

The first parameter for <hintName> must be a positive byte-size literal, but got <advisoryPartitionSize>.

INVALID_RECURSIVE_CTE

SQLSTATE: 42836

Invalid recursive definition found. Recursive queries must contain an UNION or an UNION ALL statement with 2 children. The first child needs to be the anchor term without any recursive references. Any top level inner CTE must not contain self references.

INVALID_RECURSIVE_REFERENCE

SQLSTATE: 42836

Invalid recursive reference found inside WITH RECURSIVE clause.

For more details see INVALID_RECURSIVE_REFERENCE

INVALID_REGEXP_REPLACE

Could not perform regexp_replace for source = "<source>", pattern = "<pattern>", replacement = "<replacement>" and position = <position>.

INVALID_RESETTABLE_DEPENDENCY

Tables <upstreamResettableTables> are resettable but have a non-resettable downstream dependency '<downstreamTable>'. reset will fail as Spark Streaming does not support deleted source data. You can either remove the <resetAllowedKey>=false property from '<downstreamTable>' or add it to its upstream dependencies.

Source catalog must not be within Unity Catalog for the SYNC command. Found <catalog>.

INVALID_SOURCE_FOR_FILTERING_SERVICE_MERGE_COMMAND

SQLSTATE: 42KDH

The source of filtering service MERGE operation can only contain projections and filters.

Please adjust the MERGE command or use a staging table as the source instead.

<stmt>

INVALID_SPARK_CONFIG

Invalid Spark config:

For more details see INVALID_SPARK_CONFIG

INVALID_SYSTEM_BUILTIN_TIMERANGE

INVALID_TIME_TRAVEL_TIMESTAMP_EXPR

The time travel timestamp expression <expr> is invalid.

For more details see INVALID_TIME_TRAVEL_TIMESTAMP_EXPR

INVALID_TIME_TRAVEL_TIMESTAMP_FORMAT

The provided timestamp <timestamp> doesn't match the expected syntax <format>.

INVALID_TYPED_LITERAL

The value of the typed literal <valueType> is invalid: <value>.

INVALID_UDF_IMPLEMENTATION

Function <funcName> does not implement a ScalarFunction or AggregateFunction.

INVALID_UPGRADE_SYNTAX

<command> <supportedOrNot> the source table is in Hive Metastore and the destination table is in Unity Catalog.

INVALID_URL

SQLSTATE: 22P02

The url is invalid: <url>. Use try_parse_url to tolerate invalid URL and return NULL instead.

INVALID_USAGE_OF_STAR_OR_REGEX

Invalid usage of <elem> in <prettyName>.

INVALID_USAGE_OF_STAR_WITH_TABLE_IDENTIFIER_IN_COUNT

count(<tableName>.*) is not allowed. Use count(*) or expand the columns manually, for example, count(col1, col2).

INVALID_UTF8_STRING

SQLSTATE: 22029

Invalid UTF8 byte sequence found in string: <str>.

INVALID_UUID

Input <uuidInput> is not a valid UUID.

The UUID should be in the format of 'xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx'

Please check the format of the UUID.

INVALID_VARIABLE_DECLARATION

SQLSTATE: 42K0M

Invalid variable declaration.

For more details see INVALID_VARIABLE_DECLARATION

The schema <schema> is not a valid variant shredding schema.

INVALID_VECTOR_NORM_DEGREE

For the <functionName> function, degree must be 1.0, 2.0, or float('inf'), but got <degree>.

INVALID_VOLUME_ACCESS

SQLSTATE: 42KDO

Entry must be a full volume path. Path '<path>' is incomplete. Expected format: /Volumes/{catalog}/{schema}/{volume}.

INVALID_WHERE_CONDITION

The WHERE condition <condition> contains invalid expressions: <expressionList>.

Rewrite the query to avoid window functions, aggregate functions, and generator functions in the WHERE clause.

INVALID_WINDOW_SPEC_FOR_AGGREGATION_FUNC

Cannot specify ORDER BY or a window frame for <aggFunc>.

INVALID_WITHIN_GROUP_EXPRESSION

SQLSTATE: 42K0K

Invalid function <funcName> with WITHIN GROUP.

For more details see INVALID_WITHIN_GROUP_EXPRESSION

INVALID_WRITER_COMMIT_MESSAGE

The data source writer has generated an invalid number of commit messages. Expected exactly one writer commit message from each task, but received <detail>.

INVALID_WRITE_DISTRIBUTION

The requested write distribution is invalid.

For more details see INVALID_WRITE_DISTRIBUTION

INVALID_XML_SCHEMA_MAP_TYPE

SQLSTATE: 2200N

Input schema <xmlSchema> can only contain STRING as a key type for a MAP.

IRC_CREDENTIAL_VENDING_ERROR

Both '<jdbcTableName>' and '<jdbcQueryString>' can not be specified at the same time.

JOIN_CONDITION_IS_NOT_BOOLEAN_TYPE

The join condition <joinCondition> has the invalid type <conditionType>, expected "BOOLEAN".

KAFKA_DATA_LOSS

Some data may have been lost because they are not available in Kafka any more;

either the data was aged out by Kafka or the topic may have been deleted before all the data in the

topic was processed.

If you don't want your streaming query to fail on such cases, set the source option failOnDataLoss to false.

Reason:

For more details see KAFKA_DATA_LOSS

KAFKA_DATA_SOURCE_NOT_ENABLED

Failed to find data source: <provider>. Please deploy the application as per the deployment section of Structured Streaming + Kafka Integration Guide.

KINESIS_COULD_NOT_READ_SHARD_UNTIL_END_OFFSET

Could not read until the desired sequence number <endSeqNum> for shard <shardId> in

kinesis stream <stream> with consumer mode <consumerMode>. The query will fail due to

potential data loss. The last read record was at sequence number <lastSeqNum>.

This can happen if the data with endSeqNum has already been aged out, or the Kinesis stream was

deleted and reconstructed with the same name. The failure behavior can be overridden

by setting spark.databricks.kinesis.failOnDataLoss to false in spark configuration.

KINESIS_EFO_CONSUMER_NOT_FOUND

For kinesis stream <streamId>, the previously registered EFO consumer <consumerId> of the stream has been deleted.

Restart the query so that a new consumer will be registered.

KINESIS_EFO_SUBSCRIBE_FAILED

Failed to subscribe to Kinesis shard <shard> for consumer <consumerId>.

KINESIS_EFO_SUBSCRIBE_LIMIT_EXCEEDED

For shard <shard> and consumer <consumerId>, another subscribeToShard call was within 5 seconds. Restart the query after 5 seconds or more.

KINESIS_EFO_SUBSCRIBE_SDK_CLIENT_ERROR

The AWS Kinesis client could not subscribe to shard <shard> for consumer <consumerId>. Lower shardsPerTask or disable reuseKinesisClient.

KINESIS_FETCHED_SHARD_LESS_THAN_TRACKED_SHARD

The minimum fetched shardId from Kinesis (<fetchedShardId>)

is less than the minimum tracked shardId (<trackedShardId>).

This is unexpected and occurs when a Kinesis stream is deleted and recreated with the same name,

and a streaming query using this Kinesis stream is restarted using an existing checkpoint location.

Restart the streaming query with a new checkpoint location, or create a stream with a new name.

KINESIS_FETCH_TIMEOUT

Reading from Kinesis stream(s) <streams> timed out after <timeoutMs> milliseconds.

KINESIS_POLLING_MODE_UNSUPPORTED

Kinesis polling mode is unsupported.

KINESIS_RECORD_SEQ_NUMBER_ORDER_VIOLATION

For shard <shard>, the last record read from Kinesis in previous fetches has sequence number <lastSeqNum>,

which is greater than the record read in current fetch with sequence number <recordSeqNum>.

This is unexpected and can happen when the start position of retry or next fetch is incorrectly initialized, and may result in duplicate records downstream.

KINESIS_SOURCE_MUST_BE_IN_EFO_MODE_TO_CONFIGURE_CONSUMERS

To read from Kinesis Streams with consumer configurations (consumerName, consumerNamePrefix, or registeredConsumerId), consumerMode must be efo.

KINESIS_SOURCE_MUST_SPECIFY_REGISTERED_CONSUMER_ID_AND_TYPE

To read from Kinesis Streams with registered consumers, you must specify both the registeredConsumerId and registeredConsumerIdType options.

KINESIS_SOURCE_MUST_SPECIFY_STREAM_NAMES_OR_ARNS

To read from Kinesis Streams, you must configure either (but not both) of the streamName or streamARN options as a comma-separated list of stream names/ARNs.

KINESIS_SOURCE_NO_CONSUMER_OPTIONS_WITH_REGISTERED_CONSUMERS

To read from Kinesis Streams with registered consumers, do not configure consumerName or consumerNamePrefix options as they will not take effect.

KINESIS_SOURCE_REGISTERED_CONSUMER_ID_COUNT_MISMATCH

The number of registered consumer ids should be equal to the number of Kinesis streams but got <numConsumerIds> consumer ids and <numStreams> streams.

KINESIS_SOURCE_REGISTERED_CONSUMER_NOT_FOUND

The registered consumer <consumerId> provided cannot be found for streamARN <streamARN>. Verify that you have registered the consumer or do not provide the registeredConsumerId option.

KINESIS_SOURCE_REGISTERED_CONSUMER_TYPE_INVALID

The registered consumer type <consumerType> is invalid. It must be either name or ARN.

KINESIS_SOURCE_STREAMS_REMOVED_ON_RESTART

The query was previously reading the streams <removedStreams>, but they are not in the current streamName or streamARN option. Continuing would stop reading their unread records, so the query fails. Add the streams back to the option, or set spark.databricks.kinesis.failOnDataLoss to false to skip them and continue with the remaining streams.

KINESIS_SOURCE_STREAM_IDENTIFIER_TYPE_MISMATCH

Cannot restart query from checkpoint created with <checkpointType> using <currentType>. Continue using <checkpointType> or start from a fresh checkpoint location.

KLL_INVALID_INPUT_SKETCH_BUFFER

Invalid call to <function>; only valid KLL sketch buffers are supported as inputs (such as those produced by the kll_sketch_agg function).

KLL_SKETCH_INVALID_QUANTILE_RANGE

For function <functionName>, the quantile value must be between 0.0 and 1.0 (inclusive).

KLL_SKETCH_K_MUST_BE_CONSTANT

For function <functionName>, the k parameter must be a constant value, but got a non-constant expression.

KLL_SKETCH_K_OUT_OF_RANGE

For function <functionName>, the k parameter must be between 8 and 65535 (inclusive), but got <k>.

KRYO_BUFFER_OVERFLOW

SQLSTATE: 54006

Kryo serialization failed: <exceptionMsg>. To avoid this, increase "<bufferSizeConfKey>" value.

LABELS_MISMATCH

Begin label <beginLabel> does not match the end label <endLabel>.

LABEL_OR_FOR_VARIABLE_ALREADY_EXISTS

The label or FOR variable <label> already exists. Choose another name or rename the existing one.

LABEL_OR_FOR_VARIABLE_NAME_FORBIDDEN

The label or FOR variable name <label> is forbidden.

LAKEBASE_LOOKUP_MULTIPLE_ROWS_MATCHED

SQLSTATE: 21000

A Lakebase lookup matched more than one row, but the key must match at most one row. Key: <key>, Query: <query>

LAKEBASE_LOOKUP_UNSUPPORTED_OUTSIDE_PROJECTION

lakebaseLookup() is only supported in the SELECT list / projection clause.

LAKEBASE_TOTABLE_OPTION_CONFLICT

Options [<conflictingOptions>] conflict with values derived from the catalog identifier when writing to a Lakebase table via toTable().

LAKEBASE_TOTABLE_REQUIRES_THREE_PART_NAME

Writing to a Lakebase table requires a three-part name 'catalog.schema.table', but got '<tableName>'.

CREATE TEMPORARY TABLE without a provider is not allowed.

LIST_FILES_AUTHORIZATION_ERROR

Not authorized to call list_files.

For more details see LIST_FILES_AUTHORIZATION_ERROR

LIST_FILES_ERROR

list_files failed.

For more details see LIST_FILES_ERROR

LOAD_DATA_PATH_NOT_EXISTS

LOAD DATA input path does not exist: <path>.

LOAD_FILE_ERROR

Error reading the content of a FILE value. Use try_cast(... AS STRING|BINARY) to skip failures and get a null value instead.

For more details see LOAD_FILE_ERROR

LOCAL_MUST_WITH_SCHEMA_FILE

LOCAL must be used together with the schema of file, but got: <actualSchema>.

LOCAL_RELATION_SIZE_LIMIT_EXCEEDED

Local relation size (<actualSize> bytes) exceeds the limit (<sizeLimit> bytes).

LOCAL_VARIABLE_IN_TEMP_OBJECT_DEFINITION

SQLSTATE: 42K0M

SQL scripting local variable <varName> cannot be referenced in the definition of temporary <objectType> <objectName>. Local variables are scoped to the current SQL script, but temporary objects persist beyond the script. If you want to create temporary <objectType> <objectName>, make <varName> a session variable.

LOCATION_ALREADY_EXISTS

Cannot name the managed table as <identifier>, as its associated location <location> already exists. Please pick a different table name, or remove the existing location first.

LOST_TOPIC_PARTITIONS_IN_END_OFFSET_WITH_TRIGGER_AVAILABLENOW

Some of partitions in Kafka topic(s) have been lost during running query with Trigger.AvailableNow. The error could be transient - restart your query, and report if you still see the same issue.

topic-partitions for latest offset: <tpsForLatestOffset>, topic-partitions for end offset: <tpsForEndOffset>

MALFORMED_AVRO_MESSAGE

Malformed Avro messages are detected in message deserialization. Parse Mode: <mode>. To process malformed Avro message as null result, try setting the option 'mode' as 'PERMISSIVE'.

For more details see MALFORMED_AVRO_MESSAGE

MALFORMED_CHARACTER_CODING

Invalid value found when performing <function> with <charset>

MALFORMED_CSV_RECORD

Malformed CSV record: <badRecord>

MALFORMED_EXPRESSION_INFO

'<fieldName>' is malformed in the expression [<exprName>]:

For more details see MALFORMED_EXPRESSION_INFO

MALFORMED_FILE_REF

FileType value is malformed.

For more details see MALFORMED_FILE_REF

MALFORMED_LOG_FILE

Log file was malformed: failed to read correct log version from <text>.

MALFORMED_PROTOBUF_MESSAGE

SQLSTATE: 42K0G

Malformed Protobuf messages are detected in message deserialization. Parse Mode: <failFastMode>. To process malformed protobuf message as null result, try setting the option 'mode' as 'PERMISSIVE'.

MALFORMED_RECORD_IN_PARSING

Malformed records are detected in record parsing: <badRecord>.

Parse Mode: <failFastMode>. To process malformed records as null result, try setting the option 'mode' as 'PERMISSIVE'.

For more details see MALFORMED_RECORD_IN_PARSING

MALFORMED_STATE_IN_RATE_PER_MICRO_BATCH_SOURCE

MATERIALIZED_VIEW_MESA_REFRESH_WITHOUT_PIPELINE_ID

Cannot <refreshType> the materialized view because it predates having a pipelineId. To enable <refreshType> please drop and recreate the materialized view.

MATERIALIZED_VIEW_NOT_INCREMENTALIZABLE

Cannot create the materialized view with <refreshPolicy> refresh policy because it is not supported for incremental refresh. Reason:

For more details see MATERIALIZED_VIEW_NOT_INCREMENTALIZABLE

MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED

The materialized view operation <operation> is not allowed:

For more details see MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED

MATERIALIZED_VIEW_OUTPUT_WITHOUT_EXPLICIT_ALIAS

Output expression <expression> in a materialized view must be explicitly aliased.

MATERIALIZED_VIEW_OVER_STREAMING_QUERY_INVALID

materialized view <name> could not be created with streaming query. Please use CREATE [OR REFRESH] STREAMING TABLE or remove the STREAM keyword to your FROM clause to turn this relation into a batch query instead.

MATERIALIZED_VIEW_UNSUPPORTED_OPERATION

Operation <operation> is currently not supported on materialized views.

MATERIALIZED_VIEW_WITH_MULTIPLE_QUERIES

Invalid destination <tableName> with multiple flows: <flows>.

MAX_NUMBER_VARIABLES_IN_SESSION_EXCEEDED

SQLSTATE: 54KD1

Cannot create the new variable <variableName> because the number of variables in the session exceeds the maximum allowed number (<maxNumVariables>).

MAX_RECORDS_PER_FETCH_INVALID_FOR_KINESIS_SOURCE

maxRecordsPerFetch needs to be a positive integer less than or equal to <kinesisRecordLimit>

MCV_INVALID_INPUT_SKETCH_BUFFER

Invalid call to <function>; only valid MCV sketch buffers are supported as inputs (such as those produced by the mcv_collect_internal function).

MERGE_CARDINALITY_VIOLATION

SQLSTATE: 23K01

The ON search condition of the MERGE statement matched a single row from the target table with multiple rows of the source table.

This could result in the target row being operated on more than once with an update or delete operation and is not allowed.

MERGE_FLOW_NOT_MATCHED_BY_SOURCE_NOT_SUPPORTED

WHEN NOT MATCHED BY SOURCE clauses are not supported in streaming MERGE flows.

MERGE_INSERT_VALUE_COUNT_MISMATCH

SQLSTATE: 21S01

The number of provided values (<actualCount>) must match the number of expected columns (<expectedCount>) in the INSERT clause of MERGE.

MERGE_WITHOUT_WHEN

There must be at least one WHEN clause in a MERGE statement.

METRIC_CONSTRAINT_NOT_SUPPORTED

METRIC CONSTRAINT is not enabled.

METRIC_STORE_INVALID_ARGUMENT_VALUE_ERROR

Provided value "<argValue>" is not supported by argument "<argName>" for the METRIC_STORE table function.

For more details see METRIC_STORE_INVALID_ARGUMENT_VALUE_ERROR

METRIC_STORE_UNSUPPORTED_ERROR

Metric Store routine <routineName> is currently disabled in this environment.

METRIC_VIEW_AMBIGUOUS_JOIN_CRITERIA

The metric view definition contains a join with an ambiguous criteria: <expr>. [Either use the using join criteria or explicitly qualify columns with the <sourceAlias> alias.]

The metric view <viewName> parameter <parameterName> at position <pos> requires <requiredType>. The argument given is <argumentType>.

METRIC_VIEW_INVALID_PARTITION_OUTER_AGGREGATE

Invalid partition.outer_aggregate <outerAggregate> for measure <measure>: <reason>

Make sure that the table being migrated is a UC external delta table and

it is referenced by its name instead of path.

MIGRATION_ROLLBACK_NOT_SUPPORTED

<table> is not supported for rollback from to managed to external table because it is not a <tableKind> table.

MISMATCHED_TOPIC_PARTITIONS_BETWEEN_END_OFFSET_AND_PREFETCHED

Kafka data source in Trigger.AvailableNow should provide the same topic partitions in pre-fetched offset to end offset for each microbatch. The error could be transient - restart your query, and report if you still see the same issue.

topic-partitions for pre-fetched offset: <tpsForPrefetched>, topic-partitions for end offset: <tpsForEndOffset>.

MISSING_AGGREGATION

The non-aggregating expression <expression> is based on columns which are not participating in the GROUP BY clause.

Add the columns or the expression to the GROUP BY, aggregate the expression, or use <expressionAnyValue> if you do not care which of the values within a group is returned.

For more details see MISSING_AGGREGATION

MISSING_ATTRIBUTES

Resolved attribute(s) <missingAttributes> missing from <input> in operator <operator> <exprs>.

For more details see MISSING_ATTRIBUTES

MISSING_AUTHORIZATION_TOKEN

No token to authorize principal

MISSING_CATALOG_ABILITY

Catalog <plugin> does not support

For more details see MISSING_CATALOG_ABILITY

MISSING_CLAUSES_FOR_OPERATION

Missing required clause(s) <clauses> for operation <operation>.

MISSING_CONNECTION_OPTION

Connections of type '<connectionType>' must include the following option(s): <requiredOptions>.

MISSING_DATABASE_FOR_V1_SESSION_CATALOG

Database name is not specified in the v1 session catalog. Please ensure to provide a valid database name when interacting with the v1 catalog.

MISSING_GROUP_BY

The query does not include a GROUP BY clause. Add GROUP BY or turn it into the window functions using OVER clauses.

MISSING_NAME_FOR_CHECK_CONSTRAINT

CHECK constraint must have a name.

MISSING_PARAMETER_FOR_KAFKA

Parameter <parameterName> is required for Kafka, but is not specified in <functionName>.

MISSING_PARAMETER_FOR_ROUTINE

Parameter <parameterName> is required, but is not specified in <functionName>.

MISSING_SCHEDULE_DEFINITION

A schedule definition must be provided following SCHEDULE.

MISSING_TIMEOUT_CONFIGURATION

SQLSTATE: HY000

The operation has timed out, but no timeout duration is configured. To set a processing time-based timeout, use 'GroupState.setTimeoutDuration()' in your 'mapGroupsWithState' or 'flatMapGroupsWithState' operation. For event-time-based timeout, use 'GroupState.setTimeoutTimestamp()' and define a watermark using 'Dataset.withWatermark()'.

MISSING_WINDOW_SPECIFICATION

SQLSTATE: 42P20

Window specification is not defined in the WINDOW clause for <windowName>. For more information about WINDOW clauses, please refer to '<docroot>/sql-ref-syntax-qry-select-window.html'.

MODIFY_BUILTIN_CATALOG

Modifying built-in catalog <catalogName> is not supported.

MULTIPART_FLOW_NAME_NOT_SUPPORTED

Flow with multipart name '<flowName>' is not supported.

MULTIPLE_DATA_SOURCES

Multiple sources found for <provider> (<sourceNames>), please specify the fully qualified class name.

MULTIPLE_EVENT_TIME_COLUMNS

More than one event time columns are available. Please ensure there is at most one event time column per stream. event time columns: <eventTimeCols>

MULTIPLE_EXCEL_DATA_SOURCE

Detected multiple Excel data sources with the name <provider> (<sourceNames>). Please specify the fully qualified class name or remove <externalSource> from the classpath.

MULTIPLE_LOAD_PATH

Databricks Delta does not support multiple input paths in the load() API.

Named parameters are not supported for function <functionName>; please retry the query with positional arguments to the function call instead.

NAMED_PARAMETERS_NOT_SUPPORTED_FOR_SQL_UDFS

Cannot call function <functionName> because named argument references are not supported. In this case, the named argument reference was <argument>.

NAMED_PARAMETER_SUPPORT_DISABLED

Cannot call function <functionName> because named argument references are not enabled here.

In this case, the named argument reference was <argument>.

Set "spark.sql.allowNamedFunctionArguments" to "true" to turn on feature.

NAMESPACE_ALREADY_EXISTS

Cannot create namespace <nameSpaceName> because it already exists.

Choose a different name, drop the existing namespace, or add the IF NOT EXISTS clause to tolerate pre-existing namespace.

NAMESPACE_NOT_EMPTY

Cannot drop a namespace <nameSpaceNameName> because it contains objects.

Use DROP NAMESPACE ... CASCADE to drop the namespace and all its objects.

NAMESPACE_NOT_FOUND

The namespace <nameSpaceName> cannot be found. Verify the spelling and correctness of the namespace.

If you did not qualify the name with, verify the current_schema() output, or qualify the name with the correctly.

To tolerate the error on drop use DROP NAMESPACE IF EXISTS.

NATIVE_IO_ERROR

SQLSTATE: KD00F

Native request failed. requestId: <requestId>, cloud: <cloud>, operation: <operation>

request: [https: <https>, method = <method>, path = <path>, params = <params>, host = <host>, headers = <headers>, bodyLen = <bodyLen>],

error: <error>

NATIVE_XML_DATA_SOURCE_NOT_ENABLED

Native XML Data Source is not enabled in this cluster.

NEAREST_BY_JOIN

Invalid nearest-by join.

For more details see NEAREST_BY_JOIN

NEGATIVE_SCALE_DISALLOWED

Negative scale is not allowed: '<scale>'. Set the config <sqlConf> to "true" to allow it.

NEGATIVE_VALUES_IN_FREQUENCY_EXPRESSION

Found the negative value in <frequencyExpression>: <negativeValue>, but expected a positive integral value.

NESTED_AGGREGATE_FUNCTION

SQLSTATE: 42607

It is not allowed to use an aggregate function in the argument of another aggregate function. Please use the inner aggregate function in a sub-query.

NESTED_DATABASE_UNSUPPORTED_BY_V1_SESSION_CATALOG

Nested databases are not supported by v1 session catalog: <namespace>.

NESTED_EXECUTE_IMMEDIATE

SQLSTATE: 07501

Nested EXECUTE IMMEDIATE commands are not allowed. Please ensure that the SQL query provided (<sqlString>) does not contain another EXECUTE IMMEDIATE command.

NESTED_REFERENCES_IN_LATERAL_SUBQUERY_NOT_SUPPORTED

Detected outer scope references <expression> in the lateral subquery which is not supported. Please ensure the lateral subquery does not contain subqueries that reference attributes from nested outer scopes.

NESTED_REFERENCES_IN_SUBQUERY_NOT_SUPPORTED

Detected outer scope references <expression> in the subquery which is not supported.

NESTED_SEQUENTIAL_STREAMING_UNION

Nested SequentialStreamingUnion is not supported. <hint>

SequentialStreamingUnion can only be used at the top level of a streaming query.

Each source in followedBy() should be a base streaming source or simple transformations,

not another followedBy() result wrapped in other operators.

NEW_CHECK_CONSTRAINT_VIOLATION

SQLSTATE: 23512

The new check constraint (<expression>) cannot be added because it would be violated by existing data in table <tableName>. Please ensure all existing rows satisfy the constraint before adding it.

NONEXISTENT_FIELD_NAME_IN_LIST

SQLSTATE: HV091

Field(s) <nonExistFields> do(es) not exist. Available fields: <fieldNames>

NON_DETERMINISTIC_CHECK_CONSTRAINT

The check constraint <checkCondition> is non-deterministic. Check constraints must only contain deterministic expressions.

NON_FOLDABLE_ARGUMENT

The function <funcName> requires the parameter <paramName> to be a foldable expression of the type <paramType>, but the actual argument is a non-foldable.

NON_LAST_MATCHED_CLAUSE_OMIT_CONDITION

When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.

NON_LAST_NOT_MATCHED_BY_SOURCE_CLAUSE_OMIT_CONDITION

When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.

NON_LAST_NOT_MATCHED_BY_TARGET_CLAUSE_OMIT_CONDITION

When there are more than one NOT MATCHED [BY TARGET] clauses in a MERGE statement, only the last NOT MATCHED [BY TARGET] clause can omit the condition.

NON_LITERAL_PIVOT_VALUES

Literal expressions required for pivot values, found <expression>.

NON_PARTITION_COLUMN

PARTITION clause cannot contain the non-partition column: <columnName>.

NON_TIME_WINDOW_NOT_SUPPORTED_IN_STREAMING

Window function is not supported in <windowFunc> (as column <columnName>) on streaming DataFrames/Datasets.

Structured Streaming only supports time-window aggregation using the WINDOW function. (window specification: <windowSpec>)

NOT_ALLOWED_IN_FROM

Not allowed in the FROM clause:

For more details see NOT_ALLOWED_IN_FROM

NOT_ALLOWED_IN_PIPE_OPERATOR_WHERE

Not allowed in the pipe WHERE clause:

For more details see NOT_ALLOWED_IN_PIPE_OPERATOR_WHERE

NOT_A_CONSTANT_STRING

The expression <expr> used for the routine or clause <name> must be a constant STRING which is NOT NULL.

For more details see NOT_A_CONSTANT_STRING

NOT_A_PARTITIONED_TABLE

Operation <operation> is not allowed for <tableIdentWithDB> because it is not a partitioned table.

NOT_A_SCALAR_FUNCTION

SQLSTATE: 42887

<functionName> appears as a scalar expression here, but the function was defined as a table function. Please update the query to move the function call into the FROM clause, or redefine <functionName> as a scalar function instead.

NOT_A_TABLE_FUNCTION

SQLSTATE: 42887

<functionName> appears as a table function here, but the function was defined as a scalar function. Please update the query to move the function call outside the FROM clause, or redefine <functionName> as a table function instead.

NOT_ENOUGH_ARGS

SQLSTATE: 42605

Function <functionName> expects at least <minNum> parameters, but received <actualNum> (<actualArgs>).

NOT_NULL_ASSERT_VIOLATION

NULL value appeared in non-nullable field: <walkedTypePath>If the schema is inferred from a Scala tuple/case class, or a Java bean, please try to use scala.Option[_] or other nullable types (such as java.lang.Integer instead of int/scala.Int).

NOT_NULL_CONSTRAINT_VIOLATION

Assigning a NULL is not allowed here.

For more details see NOT_NULL_CONSTRAINT_VIOLATION

NOT_STREAMING_DATASET

SQLSTATE: 42K0A

All sources in <operator> must be streaming relations.

Ensure all DataFrames are created using spark.readStream() rather than spark.read().

NOT_SUPPORTED_WITH_DB_SQL

<operation> is not supported on a SQL <endpoint>.

NOT_SUPPORTED_WITH_SERVERLESS

<operation> is not supported on serverless compute.

NOT_UNRESOLVED_ENCODER

Unresolved encoder expected, but <attr> was found.

NO_ACTIVE_TRANSACTION

There is no active transaction to <action>.

NO_DEFAULT_COLUMN_VALUE_AVAILABLE

SQLSTATE: 42608

Can't determine the default value for <colName> since it is not nullable and it has no default value.

NO_HANDLER_FOR_UDAF

No handler for UDAF '<functionName>'. Use sparkSession.udf.register(...) instead.

NO_MERGE_ACTION_SPECIFIED

df.mergeInto needs to be followed by at least one of whenMatched/whenNotMatched/whenNotMatchedBySource.

NO_PARENT_EXTERNAL_LOCATION_FOR_PATH

No parent external location was found for path '<path>'. Please create an external location on one of the parent paths and then retry the query or command again.

NO_PRIMARY_KEY_CONSTRAINT_EXCEPTION

TABLE <table> does not have a primary key constraint.

NO_SQL_TYPE_IN_PROTOBUF_SCHEMA

SQLSTATE: 42S22

Cannot find <catalystFieldPath> in Protobuf schema.

NO_STORAGE_LOCATION_FOR_TABLE

SQLSTATE: none assigned

No storage location was found for table '<tableId>' when generating table credentials. Please verify the table type and the table location URL and then retry the query or command again.

NO_SUCH_CATALOG_EXCEPTION

Catalog '<catalog>' was not found. Please verify the catalog name and then retry the query or command again.

NO_SUCH_CLEANROOM_EXCEPTION

SQLSTATE: none assigned

The clean room '<cleanroom>' does not exist. Please verify that the clean room name is spelled correctly and matches the name of a valid existing clean room and then retry the query or command again.

NO_SUCH_CONSTRAINT_EXCEPTION

Constraint <constraint> not found in <identifier>.

NO_SUCH_CREDENTIAL_EXCEPTION

The credential '<credential>' does not exist. Please verify that the credential name is spelled correctly and matches the name of a valid existing credential and then retry the query or command again.

NO_SUCH_EXTERNAL_LOCATION_EXCEPTION

SQLSTATE: none assigned

The external location '<externalLocation>' does not exist. Please verify that the external location name is correct and then retry the query or command again.

NO_SUCH_METASTORE_EXCEPTION

NUM_COLUMNS_MISMATCH

SQLSTATE: 42826

<operator> can only be performed on inputs with the same number of columns, but the first input has <firstNumColumns> columns and the <invalidOrdinalNum> input has <invalidNumColumns> columns.

NUM_TABLE_VALUE_ALIASES_MISMATCH

SQLSTATE: 42826

Number of given aliases does not match number of output columns.

Function name: <funcName>; number of aliases: <aliasesNum>; number of output columns: <outColsNum>.

OAUTH_CUSTOM_IDENTITY_CLAIM_NOT_PROVIDED

SQLSTATE: 22KD2

No custom identity claim was provided.

ONLY_SECRET_FUNCTION_SUPPORTED_HERE

Calling function <functionName> is not supported in this <location>; <supportedFunctions> supported here.

ONLY_SUPPORTED_WITH_UC_SQL_CONNECTOR

SQL operation <operation> is only supported on Databricks SQL connectors with Unity Catalog support.

OPERATION_CANCELED

SQLSTATE: HY008

Operation has been canceled.

OPERATION_REQUIRES_UNITY_CATALOG

SQLSTATE: 0AKUD

Operation <operation> requires Unity Catalog enabled.

OPTION_VALUE_EXCEEDS_ONE_CHARACTER

The value of <paramName> cannot be more than one character, but got <actualValue>.

OP_NOT_SUPPORTED_READ_ONLY

SQLSTATE: 42KD1

<plan> is not supported in read-only session mode.

ORC_DATA_SOURCE_REQUIRES_HIVE_SUPPORT

Hive built-in ORC data source must be used with Hive support enabled. Please use the native ORC data source by setting 'spark.sql.orc.impl' to 'native'.

ORDER_BY_POS_OUT_OF_RANGE

SQLSTATE: 42805

ORDER BY position <index> is not in select list (valid range is [1, <size>]).

PARAMETER_BATCH_ERROR

Error processing the provided parameter batch.

For more details see PARAMETER_BATCH_ERROR

PARQUET_AGGREGATE_PUSH_DOWN_UNSUPPORTED

Aggregate push-down is not supported for Parquet file <filePath>. Set SQLConf <config> to false and execute again.

For more details see PARQUET_AGGREGATE_PUSH_DOWN_UNSUPPORTED

PARQUET_CONVERSION_FAILURE

Choose a different name, drop the existing partition, or add the IF NOT EXISTS clause to tolerate a pre-existing partition.

PARTITIONS_NOT_FOUND

SQLSTATE: 428FT

The partition(s) <partitionList> cannot be found in table <tableName>.

Verify the partition specification and table name.

To tolerate the error on drop use ALTER TABLE … DROP IF EXISTS PARTITION.

PARTITION_BY_NOT_ALLOWED_WITH_INSERT_INTO

partitionBy() cannot be used with insertInto(). Partition columns for table <tableName> are determined by the table definition.

PARTITION_COLUMN_NOT_FOUND_IN_SCHEMA

Partition column <column> not found in schema <schema>. Please provide the existing column for partitioning.

PARTITION_LOCATION_ALREADY_EXISTS

Partition location <locationPath> already exists in table <tableName>.

PARTITION_LOCATION_IS_NOT_UNDER_TABLE_DIRECTORY

SQLSTATE: 42KD5

Failed to execute the ALTER TABLE SET PARTITION LOCATION statement, because the

partition location <location> is not under the table directory <table>.

To fix it, please set the location of partition to a subdirectory of <table>.

PARTITION_METADATA

<action> is not allowed on table <tableName> since storing partition metadata is not supported in Unity Catalog.

PARTITION_NUMBER_MISMATCH

Number of values (<partitionNumber>) did not match schema size (<partitionSchemaSize>): values are <partitionValues>, schema is <partitionSchema>, file path is <urlEncodedPath>.

Please re-materialize the table or contact the owner.

PARTITION_RENAME_NOT_SUPPORTED

Partition renaming is not supported.

PARTITION_TRANSFORM_EXPRESSION_NOT_IN_PARTITIONED_BY

SQLSTATE: 42S23

The expression <expression> must be inside 'partitionedBy'.

PATH_ALREADY_EXISTS

Path <outputPath> already exists. Set mode as "overwrite" to overwrite the existing path.

PATH_NOT_FOUND

Path does not exist: <path>.

PATH_RESOLUTION_ERROR

SQLSTATE: KD013

Could not resolve path <path>. Caused by: <causedBy>

PHOTON_DESERIALIZED_PROTOBUF_MEMORY_LIMIT_EXCEEDED

Deserializing the Photon protobuf plan requires at least <size> bytes, which exceeds the

limit of <limit> bytes. This could be due to a very large plan or the presence of a very

wide schema. Try to simplify the query, remove unnecessary columns, or disable Photon.

PHOTON_SERIALIZED_PROTOBUF_MEMORY_LIMIT_EXCEEDED

The serialized Photon protobuf plan has size <size> bytes, which exceeds the limit of

<limit> bytes. The serialized size of data types in the plan is <dataTypeSize> bytes.

This could be due to a very large plan or the presence of a very wide schema.

Consider rewriting the query to remove unwanted operations and columns or disable Photon.

PIPELINE_DATASET_WITHOUT_FLOW

Pipeline dataset <identifier> does not have any defined flows. Please attach a query with the dataset's definition, or explicitly define at least one flow that writes to the dataset.

PIPELINE_DOES_NOT_EXIST

Pipeline '<pipelineId>' does not exist

For more details see PIPELINE_DOES_NOT_EXIST

PIPELINE_DUPLICATE_IDENTIFIERS

A duplicate identifier was found for elements registered in the pipeline's dataflow graph.

For more details see PIPELINE_DUPLICATE_IDENTIFIERS

PIPELINE_FLOW_MISSING_DEPENDENCY

SQLSTATE: HY000

Flow <flowName> cannot be fully analyzed due to missing dependencies: <dependencies>. This flow will be retried when dependencies become available.

PIPELINE_GRAPH_NOT_TOPOLOGICALLY_SORTED

There is a cycle between <flowName> and <inputName>.

PIPELINE_RUN_FAILED

SQLSTATE: 42K0S

<message>

PIPELINE_SQL_GRAPH_ELEMENT_REGISTRATION_ERROR

<message>

<offendingQuery>

<codeLocation>

PIPELINE_STORAGE_ROOT_INVALID

Pipeline storage root must be an absolute path with a URI scheme (for example, file://, s3a://, hdfs://). Got: <storage_root>.

PIPELINE_TESTING_UNSUPPORTED_OPERATION

The operation <operation> on <target> is not supported in Lakeflow pipeline unit testing. Run it outside of pipeline unit testing.

PIPE_OPERATOR_AGGREGATE_EXPRESSION_CONTAINS_NO_AGGREGATE_FUNCTION

Non-grouping expression <expr> is provided as an argument to the |> AGGREGATE pipe operator but does not contain any aggregate function; please update it to include an aggregate function and then retry the query again.

PIPE_OPERATOR_CONTAINS_AGGREGATE_FUNCTION

Aggregate function <expr> is not allowed when using the pipe operator |> <clause> clause; please use the pipe operator |> AGGREGATE clause instead.

PIVOT_VALUE_DATA_TYPE_MISMATCH

Invalid pivot value '<value>': value data type <valueType> does not match pivot column data type <pivotType>.

POLICY_ALREADY_EXISTS

Cannot create policy <policyName> because it already exists.

Choose a different name or drop the existing policy to tolerate pre-existing connections.

POLICY_NOT_FOUND

PROTOBUF_NOT_LOADED_SQL_FUNCTIONS_UNUSABLE

PYTHON_EXCEPTION

<msg>: <traceback>

PYTHON_STREAMING_DATA_SOURCE_RUNTIME_ERROR

Failed when Python streaming data source perform <action>: <msg>

QUERIED_TABLE_INCOMPATIBLE_WITH_COLUMN_MASK_POLICY

SQLSTATE: 428HD

Unable to access referenced table because a previously assigned column mask is currently incompatible with the table schema; to continue, please contact the owner of the table to update the policy:

For more details see QUERIED_TABLE_INCOMPATIBLE_WITH_COLUMN_MASK_POLICY

QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_LEVEL_SECURITY_POLICY

SQLSTATE: 428HD

Unable to access referenced table because a previously assigned row level security policy is currently incompatible with the table schema; to continue, please contact the owner of the table to update the policy:

For more details see QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_LEVEL_SECURITY_POLICY

QUERY_EXECUTION_TIMEOUT_EXCEEDED

SQLSTATE: 57KD0

Query execution was cancelled due to exceeding the timeout (<timeoutSec>s). You can increase the limit in seconds by setting <config>.

QUERY_INCOMPATIBLE_WITH_RLSCM_POLICY

See go/rowcolumncontrols-allowlist. LogicalPlan <unknownLogicalPlan> is incompatible with RLS/CM policy.

QUERY_REJECTED

SQLSTATE: 08004

Query execution was rejected.

QUERY_RESULT_BATCH_TOO_LARGE

The query result batch exceeded the maximum supported size of <maxBatchSize> bytes. The table may contain rows that are too large.

QUERY_RESULT_WRITE_TO_CLOUD_STORE_BUCKET_NOT_FOUND

The cloud storage bucket <bucket> configured for query results does not exist or is misconfigured.

QUERY_RESULT_WRITE_TO_CLOUD_STORE_PERMISSION_ERROR

The workspace internal storage configuration prevents Databricks from accessing the cloud store.

QUERY_TAGS_NOT_IMPLEMENTED_ERROR

Query tags is not yet supported in SQL.

QUERY_TAGS_SYNTAX_INVALID

Invalid format for SET QUERY_TAGS command.

QUERY_TAG_KEY_INVALID

Query tag key '<key>' failed validation.

QUERY_TAG_KEY_MAY_NOT_BE_EMPTY

SQLSTATE: 2200E

Query tag key may not be null or empty. Leading and trailing whitespace is trimmed on keys and values.

RENAME_SRC_PATH_NOT_FOUND

Failed to rename as <sourcePath> was not found.

RENAME_TABLE_SOURCE_DESTINATION_DATABASE_MISMATCH

RENAME TABLE source and destination databases do not match: <db> != <newDb>.

RENAME_TEMP_VIEW_WITH_DATABASE

RENAME TEMPORARY VIEW from <oldName> to <newName>: cannot specify database name <db> in the destination table.

REPEATED_CLAUSE

The <clause> clause may be used at most once per <operation> operation.

REPLACE_WHERE_PREDICATE_OVERRIDE_UNSUPPORTED

SQLSTATE: 42KDD

Predicate overrides cannot be specified for table <tableName> because a REFRESH WHERE flow writing to the table does not exist. Remove the WHERE clause and try again.

REQUIRED_PARAMETER_ALREADY_PROVIDED_POSITIONALLY

The routine <routineName> required parameter <parameterName> has been assigned at position <positionalIndex> without the name.

Please update the function call to either remove the named argument with <parameterName> for this parameter or remove the positional

argument at <positionalIndex> and then try the query again.

REQUIRED_PARAMETER_NOT_FOUND

Cannot invoke routine <routineName> because the parameter named <parameterName> is required, but the routine call did not supply a value. Please update the routine call to supply an argument value (either positionally at index <index> or by name) and retry the query again.

REQUIRES_EXPLICIT_NAME_IN_WATERMARK_CLAUSE

The watermark clause requires an explicit name if expression is specified, but got <sqlExpr>.

REQUIRES_SINGLE_PART_NAMESPACE

<sessionCatalog> requires a single-part namespace, but got identifier <identifier>.

RESCUED_DATA_COLUMN_CONFLICT_WITH_SINGLE_VARIANT

The 'rescuedDataColumn' DataFrame API reader option is mutually exclusive with the 'singleVariantColumn' DataFrame API option.

Please remove one of them and then retry the DataFrame operation again.

RESERVED_CDC_COLUMNS_ON_WRITE

Rolling window orderBy column <columnName> must be of TimestampType, but got <columnType>.

ROLLING_WINDOW_UNSUPPORTED_MONTH_INTERVAL

Rolling window does not support year-month intervals: <interval>. Use a day-time interval instead.

ROLLING_WINDOW_WITH_EXISTING_WINDOW_SPEC

A rolling window specification cannot be applied to a column that already has a window specification.

ROLLING_WINDOW_WITH_REGULAR_WINDOW_SPEC

A column with a rolling window specification cannot have a regular window specification applied to it.

ROUTINE_ALREADY_EXISTS

SQLSTATE: 42723

Cannot create the <newRoutineType> <routineName> because a <existingRoutineType> of that name already exists.

Choose a different name, drop or replace the existing <existingRoutineType>, or add the IF NOT EXISTS clause to tolerate a pre-existing <newRoutineType>.

ROUTINE_NOT_FOUND

The routine <routineName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP ... IF EXISTS.

ROUTINE_PARAMETER_NOT_FOUND

The routine <routineName> does not support the parameter <parameterName> specified at position <pos>.<suggestion>

ROUTINE_USES_SYSTEM_RESERVED_CLASS_NAME

The function <routineName> cannot be created because the specified classname '<className>' is reserved for system use. Please rename the class and try again.

ROW_COLUMN_ACCESS_AMBIGUOUS_LITERAL_PARSEABLE_PARAMETERS

Ambiguous literal parseable parameters in policies for table <tableName> are not supported: <parameterDetails>.

ROW_FILTER_CONCURRENT_MODIFICATION

The operation on table <tableName> failed because it was modified by another concurrent operation. Retry your statement so that it applies to the latest version of the table.

ROW_LEVEL_SECURITY_CHECK_CONSTRAINT_UNSUPPORTED

Creating CHECK constraint on table <tableName> with row level security policies is not supported.

ROW_LEVEL_SECURITY_COLUMN_MASK_FEATURE_NOT_SUPPORTED

Row level security policies and column mask policies for <tableName> are not supported:

For more details see ROW_LEVEL_SECURITY_COLUMN_MASK_FEATURE_NOT_SUPPORTED

ROW_LEVEL_SECURITY_COLUMN_MASK_INVALID_FUNCTION_NAME

Invalid function name: <functionName>. A row filter or column mask function name may comprise at most three parts: catalog.schema.function.

ROW_LEVEL_SECURITY_COLUMN_MASK_UNRESOLVED_REFERENCE_COLUMN

A column with name <objectName> referenced in a row filter or column mask function parameter cannot be resolved.

This may happen if the underlying table schema has changed and the referenced column no longer exists.

For example, this can occur if the column was removed in an external system (for example, a federated table), or if a REPLACE operation on the table dropped the column.

To resolve this, users with management privileges on the table can inspect the current row filters and column masks using DESCRIBE TABLE EXTENDED, and drop or re-create any that reference non-existent columns using ALTER TABLE ... SET/DROP ROW FILTER or MASK.

Note: Databricks introduced a safety improvement to preserve column masks during REPLACE operations when the new schema includes the same column, even if the mask is not specified. This prevents unintentional policy loss on tables.

ROW_LEVEL_SECURITY_DUPLICATE_COLUMN_NAME

A <statementType> statement attempted to assign a row level security policy to a table, but two or more referenced columns had the same name <columnName>, which is invalid.

ROW_LEVEL_SECURITY_FEATURE_NOT_SUPPORTED

Row level security policies for <tableName> are not supported:

For more details see ROW_LEVEL_SECURITY_FEATURE_NOT_SUPPORTED

ROW_LEVEL_SECURITY_INCOMPATIBLE_SCHEMA_CHANGE

Unable to <statementType> <columnName> from table <tableName> because it's referenced in a row level security policy. The table owner must remove or alter this policy before proceeding.

ROW_LEVEL_SECURITY_INCONSISTENT_ROW_FILTERS

Multiple non-equivalent row filters are defined on <tableName>:

SALESFORCE_DATA_SHARE_API_UNAUTHORIZED

SQLSTATE: 42505

Authorization to the Salesforce Data Share API failed. Verify that the Databricks connection details are provided to the appropriate Salesforce data share target.

SAMPLE_TABLE_PERMISSIONS

Permissions not supported on sample databases/tables.

SCALAR_FUNCTION_NOT_COMPATIBLE

SQLSTATE: 42K0O

ScalarFunction <scalarFunc> not overrides method 'produceResult(InternalRow)' with custom implementation.

SCALAR_FUNCTION_NOT_FULLY_IMPLEMENTED

SQLSTATE: 42K0P

ScalarFunction <scalarFunc> not implements or overrides method 'produceResult(InternalRow)'.

SCALAR_SUBQUERY_IS_IN_GROUP_BY_OR_AGGREGATE_FUNCTION

The correlated scalar subquery '<sqlExpr>' is neither present in GROUP BY, nor in an aggregate function.

Add it to GROUP BY using ordinal position or wrap it in first() (or first_value) if you don't care which value you get.

SCALAR_SUBQUERY_TOO_MANY_ROWS

SQLSTATE: 21000

More than one row returned by a subquery used as an expression.

SCDS_COMMIT_LOG_UNAVAILABLE

The commit log does not exist with checkpoint location=<checkpointLocation>.

SCDS_INVALID_OPTION_VALUE

Invalid value for source option=<optionName> with errorMsg=<message>.

SCDS_OFFSET_LOG_UNAVAILABLE

The offset log does not exist with checkpoint location=<checkpointLocation>.

SCDS_REQUIRED_OPTION_UNSPECIFIED

Failed to specify required option=<optionName>.

SCHEDULE_ALREADY_EXISTS

Cannot add <scheduleType> to a table that already has <existingScheduleType>. Please drop the existing schedule or use ALTER TABLE ... ALTER <scheduleType> ... to alter it.

SCHEDULE_PERIOD_INVALID

The schedule period for <timeUnit> must be an integer value between 1 and <upperBound> (inclusive). Received: <actual>.

SCHEMA_ALREADY_EXISTS

SQLSTATE: 42P06

Cannot create schema <schemaName> because it already exists.

Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema.

SCHEMA_NOT_EMPTY

SQLSTATE: 2BP01

Cannot drop a schema <schemaName> because it contains objects.

Use DROP SCHEMA ... CASCADE to drop the schema and all its objects.

SCHEMA_NOT_FOUND

The schema <schemaName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a catalog, verify the current_schema() output, or qualify the name with the correct catalog.

To tolerate the error on drop use DROP SCHEMA IF EXISTS.

SCHEMA_REGISTRY_CONFIGURATION_ERROR

SQLSTATE: 42K0G

Schema from schema registry could not be initialized. <reason>.

SEARCH_ARGUMENT_NOT_CONSTANT

SEARCH requires the <argument> argument to be a string constant, but <actualExpr> was given.

SEARCH_ARGUMENT_NOT_LITERAL

SEARCH requires the <argument> argument to be a string literal, but <actualExpr> was given.

For more details see SEARCH_ARGUMENT_NOT_LITERAL

SEARCH_INDEX_CATALOG_SCHEMA_MISMATCH

Cannot create search index <indexName> in catalog <indexCatalog> and schema <indexSchema>. Index must be created in the same catalog and schema as the base table <tableName> (<tableCatalog>.<tableSchema>).

SEARCH_INDEX_CLUSTER_BY_NOT_SUPPORTED

The CLUSTER BY clause is not supported for search index creation. Create the search index without a CLUSTER BY clause.

SEARCH_INDEX_CLUSTER_BY_UNSUPPORTED_COLUMN_TYPE

SQLSTATE: 42HA2

CLUSTER BY column <columnName> has type <actualType>, which is not supported.

For more details see SEARCH_INDEX_CLUSTER_BY_UNSUPPORTED_COLUMN_TYPE

SEARCH_INDEX_CORRUPT_METADATA

Cannot read metadata for index <indexName>. Drop the index and recreate it.

For more details see SEARCH_INDEX_CORRUPT_METADATA

SEARCH_INDEX_INVALID_PARAMETERS

Cannot create the search index because a parameter is invalid.

For more details see SEARCH_INDEX_INVALID_PARAMETERS

SEARCH_INDEX_NAME_CONFLICTS_WITH_TABLE

Cannot create the search index because a table named <indexName> already exists. Specify a different index name.

SEARCH_INDEX_OUTDATED_SCHEMA

Search index <indexName> has an outdated schema. Recreate the index using:

DROP INDEX <indexName>;

CREATE SEARCH INDEX <indexName> ON <tableName>(<columnsList>);

SEARCH_INDEX_STAR_ARGUMENT_NOT_ALLOWED

CREATE SEARCH INDEX does not accept a star (*) argument. Indexed columns must be listed explicitly.

SEARCH_INVALID_IP_PATTERN

In IP mode, the search pattern must be a valid IPv4 or IPv6 address or CIDR notation, but got <inputValue>.

Valid formats: '192.168.1.1', '192.168.0.0/24' (IPv4), '2001:db8::1', '2001:db8::/32' (IPv6), '::ffff:192.168.1.1' (IPv4-mapped IPv6).

IPv4 octets must be 0-255 with prefix 0-32. IPv6 uses hex groups with prefix 0-128.

SEARCH_INVALID_WORD_PATTERN

In word mode, the search pattern must contain at least one word token, but got <pattern>.

Provide a string with at least one word.

SEARCH_REQUIRES_SEARCHABLE_COLUMNS

<context> requires searchable columns: STRING with UTF8_BINARY collation, VARIANT, STRUCT (with searchable fields), or ARRAY of searchable types.

For more details see SEARCH_REQUIRES_SEARCHABLE_COLUMNS

SEARCH_STAR_ARGUMENT_NOT_ALLOWED

The SEARCH and ISEARCH functions do not accept a star (*) argument. Searchable columns must be listed explicitly.

SECOND_FUNCTION_ARGUMENT_NOT_INTEGER

The second argument of <functionName> function needs to be an integer.

SECRET_EXPIRATION_INVALID_TIMESTAMP

The EXPIRATION clause in CREATE SECRET requires a TIMESTAMP or TIMESTAMP_NTZ typed literal, for example, EXPIRATION TIMESTAMP_NTZ '2025-12-31 23:59:59'. Please provide a valid typed timestamp literal and retry the command.

SECRET_FUNCTION_INVALID_LOCATION

Cannot execute <commandType> command with one or more non-encrypted references to the SECRET function; please encrypt the result of each such function call with AES_ENCRYPT and try the command again

SECURABLE_DOES_NOT_EXIST

<securable> does not exist.

SEED_EXPRESSION_IS_UNFOLDABLE

The seed expression <seedExpr> of the expression <exprWithSeed> must be foldable.

SERIALIZATION_FAILED

SQLSTATE: 58031

Serialization failed while writing object. Serializer: <serializerClass>, Error Message: <errorMessage>

SERVER_IS_BUSY

SQLSTATE: 08KD1

The server is busy and could not handle the request. Please wait a moment and try again.

SETTING_PIPELINES_PIPELINE_ID_NOT_SUPPORTED

Setting pipelines.pipelineId via ALTER TABLE ... SET TBLPROPERTIES is not supported.

SET_QUERY_TAGS_SYNTAX_INVALID

Failed to execute the SET command because the syntax was invalid. The expected syntax for this command is SET QUERY_TAGS or SET QUERY_TAGS['key'] = 'value'. Please fix the command to conform to this syntax and then re-run it again.

SFTP_DEPRECATED_SSH_RSA_KEY_ALGORITHM

The SFTP server <host>:<port> is using the deprecated SSH RSA algorithm for key exchange.

Consider upgrade the SFTP server to use a more secure algorithm such as ECDSA or ED25519.

Alternatively, bypass this error by setting <escapeHatchConf> to true

SFTP_MISSING_CREDENTIALS

SFTP password or private key file is not set. Please check if you've provided one through options or through a UC connection.

SFTP_NOT_ENABLED

SFTP file system is not enabled.

SFTP_UNABLE_TO_CONNECT

Failed to connect to SFTP server <host> on port <port> with username <user>.

<error>

SFTP_UNKNOWN_HOST_KEY

The host key of the SFTP server <host> is unknown or has changed.

Please verify the error message below, then provide the key fingerprint in the Key fingerprint field.

For example, if the message states 'ECDSA key fingerprint is SHA256:XXX/YYY', submit 'SHA256:XXX/YYY' as the key fingerprint.

Connection error message:

<error>

SFTP_URI_AND_CREDENTIAL_MISMATCH

When loading data from an SFTP path using the 'databricks.connection' option, the

configuration in the SFTP URI does not match the Unity Catalog connection credentials

for path <path>. Please update your SFTP URI or Unity Catalog connection to ensure the

host, port, and user are consistent.

For more details see SFTP_URI_AND_CREDENTIAL_MISMATCH

SHOW_COLUMNS_WITH_CONFLICT_NAMESPACE

SHOW COLUMNS with conflicting namespaces: <namespaceA> != <namespaceB>.

SHOW_STATISTICS_REQUIRES_AS_JSON

SHOW STATISTICS requires AS JSON. Syntax: SHOW STATISTICS FROM table_name [FOR COLUMNS c1, ... | FOR ALL COLUMNS] AS JSON.

SHOW_STATISTICS_UNSUPPORTED_TABLE_TYPE

SHOW STATISTICS is not supported for the table type of <tableName>.

SKETCH_INVALID_LG_NOM_ENTRIES

Invalid call to <function>; the lgNomEntries value must be between <min> and <max>, inclusive: <value>.

SQLSTATE: 07501

SQL Scripts in EXECUTE IMMEDIATE commands are not allowed. Please ensure that the SQL query provided (<sqlString>) is not SQL Script. Make sure the sql_string is a well-formed SQL statement and does not contain BEGIN and END.

SQL_SCRIPT_MAX_NESTING_DEPTH_EXCEEDED

SQL Script nests at least <nestingDepth> levels deep, exceeding the maximum allowed depth of <maxNestingDepth>.

SQL_SCRIPT_MAX_NUMBER_OF_CHARACTERS_EXCEEDED

Maximum number of characters in a SQL Script (id: <scriptId>) has been exceeded. The maximum number of characters allowed is <maxChars>, and the script had <chars> characters.

SQL_SCRIPT_MAX_NUMBER_OF_LINES_EXCEEDED

Maximum number of lines in a SQL Script (id: <scriptId>) has been exceeded. The maximum number of lines allowed is <maxLines>, and the script had <lines> lines.

SQL_SCRIPT_MAX_NUMBER_OF_LOCAL_VARIABLE_DECLARATIONS_EXCEEDED

SQLSTATE: 54KD1

Maximum number of local variable declarations in a SQL Script (id: <scriptId>) has been exceeded. The maximum number of declarations allowed is <maxDeclarations>, and the script had <declarations>.

SQL_STORED_PROCEDURES_NESTED_CALLS_LIMIT_EXCEEDED

Maximum number of nested procedure calls has been exceeded with procedure (name: <procedureName>, callId: <procedureCallId>). The maximum allowed number of nested procedure calls is <limit>.

SQS_ACCESS_DENIED

Access denied to the Amazon SQS queue '<queueUrl>' while starting the SQS stream opened with spark.readStream.format("sqs") or the read_sqs SQL table-valued function. The credentials may lack the required permissions, or the queue's KMS key or resource policy may deny access. Grant the credentials access to the queue and then retry your query or command again.

SQS_CHECKPOINT_VERSION_TOO_NEW

Cannot resume the SQS stream opened with spark.readStream.format("sqs") or the read_sqs SQL table-valued function because its checkpoint was written by a newer source version <persistedVersion> than this runtime supports (<supportedVersion>). Upgrade to a runtime that supports version <persistedVersion> or start a new stream.

SQS_DECODE_ERROR

The Amazon SQS stream was unable to decode a staged row: <row>. The stream's staged data may be corrupted.

SQS_FETCH_RETRY_EXCEPTION

SQS fetch task was retried unexpectedly (partition=<partitionInfo>, stage=<stageInfo>, task=<taskId>, queryId=<queryId>, queryRunId=<queryRunId>).

SQS_INCONSISTENT_METADATA_STORE_VERSIONS

Cannot resume the SQS stream opened with spark.readStream.format("sqs") or the read_sqs SQL table-valued function because its deduplication metadata store partitions are at inconsistent versions (<versions>). Restart the streaming query with a new checkpoint location and then retry your query or command again.

SQS_INVALID_EMPTY_OPTION

The read option '<key>' for the Amazon SQS stream must not be an empty string. Set '<key>' to a non-empty value in spark.readStream.format("sqs").option("<key>", ...) or the read_sqs SQL table-valued function, and then retry your query or command again.

SQS_INVALID_KEY_TYPE

The Amazon SQS stream encountered an invalid key type during message deduplication: <key>.

SQS_INVALID_OPTION

The read option '<key>' for the Amazon SQS stream has an invalid value. Correct '<key>' in spark.readStream.format("sqs").option("<key>", ...) or the read_sqs SQL table-valued function, and then retry your query or command again.

SQS_INVALID_OPTION_TYPE

The read option '<key>' for the Amazon SQS stream must be of type <type>. Set '<key>' to a <type> value in spark.readStream.format("sqs").option("<key>", ...) or the read_sqs SQL table-valued function, and then retry your query or command again.

SQS_INVALID_READ_LIMIT

The Amazon SQS stream received an unsupported read limit: <limit>. Configure a supported read limit such as the maxFilesPerTrigger or maxBytesPerTrigger option on spark.readStream.format("sqs") or the read_sqs SQL table-valued function, and then retry your query or command again.

SQS_MISSING_REQUIRED_OPTION

The Amazon SQS stream is missing the required read option '<key>'. Provide '<key>' via spark.readStream.format("sqs").option("<key>", ...) or as a read_sqs SQL table-valued function argument, and then retry your query or command again.

SQS_MOVING_CHECKPOINT_FAILURE

The Amazon SQS stream failed to move a raw checkpoint file from <src> to <dest>.

SQS_MULTIPLE_FAILED_EPOCHS

The Amazon SQS stream cannot start because multiple fetch epochs failed: <failedEpochs>.

SQS_OPTION_NOT_IN_BOUNDS

The read option '<key>' for the Amazon SQS stream must be in the range (<min>, <max>). Set '<key>' to a value in that range in spark.readStream.format("sqs").option("<key>", ...) or the read_sqs SQL table-valued function, and then retry your query or command again.

SQS_QUEUE_NOT_FOUND

The Amazon SQS queue '<queueUrl>' was not found in region '<region>' while starting the SQS stream opened with spark.readStream.format("sqs") or the read_sqs SQL table-valued function. Verify the queueUrl and region read options are correct and then retry your query or command again.

SQS_REGION_NOT_DERIVABLE

Could not derive the AWS region from the Amazon SQS read option '<queueUrlKey>'. Set the '<regionKey>' option in spark.readStream.format("sqs").option("<regionKey>", ...) or the read_sqs SQL table-valued function, and then retry your query or command again.

SQS_SPARK_SPECULATION_NOT_SUPPORTED

SQS streaming, opened with spark.readStream.format("sqs") or the read_sqs SQL table-valued function, is not compatible with speculative execution. Disable speculative execution by setting 'spark.speculation' to 'false' on the cluster, then restart the stream.

SQS_UNABLE_TO_PARSE_PROTO

Could not read the SQS stream's checkpoint state. The checkpoint may be corrupted.

SQS_UNSUPPORTED_GET_OFFSET_CALL

getOffset is not supported by the SQS source; use latestOffset instead.

STAGING_PATH_CURRENTLY_INACCESSIBLE

Transient error while accessing target staging path <path>, please try in a few minutes

STAR_EXPAND_NON_STRUCT_TYPE

Unknown time mode <timeMode>. Accepted timeMode modes are 'none', 'processingTime', 'eventTime'

STATE_KEY_SCHEMA_EVOLUTION_INVALID_CHECKPOINT

Cannot evolve the key columns of dropDuplicates or dropDuplicatesWithinWatermark.

The provided checkpoint location '<checkpointLocation>' is in an invalid state.

For more details see STATE_KEY_SCHEMA_EVOLUTION_INVALID_CHECKPOINT

STATE_REPARTITION_INVALID_CHECKPOINT

The provided checkpoint location '<checkpointLocation>' is in an invalid state.

For more details see STATE_REPARTITION_INVALID_CHECKPOINT

STATE_REPARTITION_INVALID_PARAMETER

The repartition parameter <parameter> is invalid:

For more details see STATE_REPARTITION_INVALID_PARAMETER

STATE_REWRITER_INVALID_CHECKPOINT

The state rewrite checkpoint location '<checkpointLocation>' is in an invalid state.

For more details see STATE_REWRITER_INVALID_CHECKPOINT

To run the query without schema validation, set spark.sql.streaming.stateStore.stateSchemaCheck to false.

Note that running without schema validation can have non-deterministic behavior.

For more details see STATE_STORE_KEY_SCHEMA_NOT_COMPATIBLE

STATE_STORE_NATIVE_ROCKSDB_TIMEOUT

When accessing RocksDB state store for stateful streaming operation, calling native RocksDB function <funcName> timed out after waiting timeout=<timeoutMs> ms. Please try again and restart the cluster if error persists.

STATE_STORE_NULL_TYPE_ORDERING_COLS_NOT_SUPPORTED

SQLSTATE: 42802

Null type ordering column with name=<fieldName> at index=<index> is not supported for range scan encoder.

STATE_STORE_PROVIDER_DOES_NOT_SUPPORT_FINE_GRAINED_STATE_REPLAY

The given State Store Provider <inputClass> does not extend org.apache.spark.sql.execution.streaming.state.SupportsFineGrainedReplay.

Therefore, it does not support option snapshotStartBatchId or readChangeFeed in state data source.

STATE_STORE_PROVIDER_MIGRATION_INVALID_CHECKPOINT

The state store provider migration checkpoint location '<checkpointLocation>' is in an invalid state.

For more details see STATE_STORE_PROVIDER_MIGRATION_INVALID_CHECKPOINT

STATE_STORE_ROCKSDB_ZIP_ALREADY_EXISTS

The RocksDB snapshot zip file <zipFilePath> already exists. This means the snapshot has already been uploaded to DFS.

(allowVersionOverwrite=<allowVersionOverwrite>, shouldUseCommitService=<shouldUseCommitService>)

STATE_STORE_STATE_SCHEMA_FILES_THRESHOLD_EXCEEDED

The number of state schema files <numStateSchemaFiles> exceeds the maximum number of state schema files for this query: <maxStateSchemaFiles>.

Added: <addedColumnFamilies>, Removed: <removedColumnFamilies>

Please set 'spark.sql.streaming.stateStore.stateSchemaFilesThreshold' to a higher number, or revert state schema modifications

STATE_STORE_UNSUPPORTED_OPERATION_ON_MISSING_COLUMN_FAMILY

SQLSTATE: 42802

State store operation=<operationType> not supported on missing column family=<colFamilyName>.

STATE_STORE_VALUE_SCHEMA_EVOLUTION_THRESHOLD_EXCEEDED

The number of state schema evolutions <numSchemaEvolutions> exceeds the maximum number of state schema evolutions, <maxSchemaEvolutions>, allowed for this column family.

Offending column family: <colFamilyName>

Please set 'spark.sql.streaming.stateStore.valueStateSchemaEvolutionThreshold' to a higher number, or revert state schema modifications

STATE_STORE_VALUE_SCHEMA_NOT_COMPATIBLE

The provided value schema does not match existing schema in operator state.

Existing schema=<storedValueSchema>; provided schema=<newValueSchema>.

To run the query without schema validation, set spark.sql.streaming.stateStore.stateSchemaCheck to false.

Note that running without schema validation can have non-deterministic behavior.

For more details see STATE_STORE_VALUE_SCHEMA_NOT_COMPATIBLE

STATE_STORE_VARIABLE_SIZE_ORDERING_COLS_NOT_SUPPORTED

SQLSTATE: 42802

Variable size ordering column with name=<fieldName> at index=<index> is not supported for range scan encoder.

STATIC_ONLY_REQUIRES_EXTENDED

STATIC ONLY modifier requires EXTENDED or FORMATTED option.

Use: DESCRIBE TABLE EXTENDED table_name STATIC ONLY

STATIC_ONLY_UNSUPPORTED_OPTION

The <option> clause is not supported with the STATIC ONLY modifier.

STATIC_PARTITION_COLUMN_IN_INSERT_COLUMN_LIST

SQLSTATE: 42713

Static partition column <staticName> is also specified in the column list.

STDS_CHANGE_FEED_ACROSS_REWIND_NOT_ALLOWED

Cannot read state change feed from batch <changeStartBatchId> to batch <changeEndBatchId> because a rewind operation occurred at batch <rewindBatchId> (rewound to batch <rewindTargetBatchId>).

The changelog is invalid across the rewind boundary.

Specify a changeStartBatchId > <rewindBatchId> or changeEndBatchId < <rewindBatchId>.

STDS_COMMITTED_BATCH_UNAVAILABLE

No committed batch found, checkpoint location: <checkpointLocation>. Ensure that the query has run and committed any microbatch before stopping.

STDS_CONFLICT_OPTIONS

The options <options> cannot be specified together. Please specify the one.

STDS_FAILED_TO_READ_OPERATOR_METADATA

Failed to read the operator metadata for checkpointLocation=<checkpointLocation> and batchId=<batchId>.

Either the file does not exist, or the file is corrupted.

Rerun the streaming query to construct the operator metadata, and report to the corresponding communities or vendors if the error persists.

STDS_FAILED_TO_READ_STATE_SCHEMA

Failed to read the state schema. Either the file does not exist, or the file is corrupted. options: <sourceOptions>.

Rerun the streaming query to construct the state schema, and report to the corresponding communities or vendors if the error persists.

STDS_INVALID_OPTION_VALUE

Invalid value for source option '<optionName>':

For more details see STDS_INVALID_OPTION_VALUE

STDS_MIXED_CHECKPOINT_FORMAT_VERSIONS_NOT_SUPPORTED

Reading state across different checkpoint format versions is not supported.

startBatchId=<startBatchId>, endBatchId=<endBatchId>.

startFormatVersion=<startFormatVersion>, endFormatVersion=<endFormatVersion>.

'<optionName>' must be specified.

STDS_SNAPSHOT_ACROSS_REWIND_NOT_ALLOWED

Cannot read state snapshot from batch <snapshotStartBatchId> to batch <batchId> because a rewind operation occurred at batch <rewindBatchId> (rewound to batch <rewindTargetBatchId>).

The snapshot chain is broken across the rewind boundary.

Specify a snapshotStartBatchId >= <rewindBatchId> or read from a batch before the rewind.

STORAGE_PARTITION_JOIN_INCOMPATIBLE_REDUCED_TYPES

Storage-partition join partition transforms produced incompatible reduced types,

left reducers: <leftReducers> returned: <leftReducedDataTypes>,

right reducers: <rightReducers> returned: <rightReducedDataTypes>.

STREAMING_AQE_NOT_SUPPORTED_FOR_STATEFUL_OPERATORS

Adaptive Query Execution is not supported for stateful operators in Structured Streaming.

STREAMING_AUTO_NAMING_SUPPORT_ERROR

The streaming query does not support automatic source naming.

For more details see STREAMING_AUTO_NAMING_SUPPORT_ERROR

STREAMING_CHECKPOINT_EXPORT_ERROR

Error performing exportCheckpoint operation on the streaming checkpoint.

For more details see STREAMING_CHECKPOINT_EXPORT_ERROR

STREAMING_CHECKPOINT_LOCATION_NOT_SPECIFIED

checkpointLocation must be specified either through option("checkpointLocation", ...) or SparkSession.conf.set("<config>", ...).

STREAMING_CHECKPOINT_LOG_WRITE_FAILURE

Failed to write a streaming query checkpoint log entry.

For more details see STREAMING_CHECKPOINT_LOG_WRITE_FAILURE

STREAMING_CHECKPOINT_METADATA_ERROR

Error with streaming checkpoint metadata.

For more details see STREAMING_CHECKPOINT_METADATA_ERROR

STREAMING_CHECKPOINT_PINNING_NOT_ENABLED

Pinning is not enabled for the streaming query with checkpoint location <checkpointLocation>.

The streaming query is running but does not have pinning enabled.

Ensure the streaming query is started with rewind/replay enabled.

STREAMING_CHECKPOINT_PIN_BATCH_ERROR

Failed to perform pin operation for streaming query with checkpoint location=<checkpointLocation> at batchId=<batchId>.

For more details see STREAMING_CHECKPOINT_PIN_BATCH_ERROR

STREAMING_CHECKPOINT_REWIND_ERROR

Failed to perform rewind operation for streaming query with checkpoint location=<checkpointLocation>.

For more details see STREAMING_CHECKPOINT_REWIND_ERROR

STREAMING_CHECKPOINT_REWIND_OPTIONS_ERROR

Error during streaming checkpoint rewind operation.

For more details see STREAMING_CHECKPOINT_REWIND_OPTIONS_ERROR

STREAMING_CHECKPOINT_SET_PROPERTIES_ERROR

Error during performing setCheckpointProperties operation on the streaming checkpoint.

For more details see STREAMING_CHECKPOINT_SET_PROPERTIES_ERROR

STREAMING_FROM_MATERIALIZED_VIEW

Cannot stream from materialized view <viewName>. Streaming from materialized views is not supported.

STREAMING_OUTPUT_MODE

Invalid streaming output mode: <outputMode>.

For more details see STREAMING_OUTPUT_MODE

STREAMING_PYTHON_RUNNER_INITIALIZATION_COMMUNICATION_FAILURE

Streaming Runner initialization failed during initial config communication. Cause: <msg>

STREAMING_QUERY_EVOLUTION_ERROR

Streaming query evolution error:

For more details see STREAMING_QUERY_EVOLUTION_ERROR

STREAMING_QUERY_ID_MISMATCH

The user-specified streaming query ID '<queryId>' does not match the ID '<checkpointQueryId>' stored in the checkpoint at '<checkpointLocation>'.

STREAMING_QUERY_STOP_TIMEOUT

SQLSTATE: 57012

Stream Execution thread for stream [id = <id>, runId = <runId>] failed to stop within <timeoutMs> milliseconds (specified by <config>). See the cause on what was being executed in the streaming query thread.

STREAMING_RATE_SOURCE_OFFSET_VERSION_MISMATCH

Expect rate source offset version <expectedVersion>, but got version <actualVersion>. To continue, set the option "version" to <expectedVersion> in the rate source options. For example, spark.readStream.format("rate").option("version", "<expectedVersion>").

STREAMING_RATE_SOURCE_V2_PARTITION_NUM_CHANGE_UNSUPPORTED

The number of partitions (<prevNum>) used in previous microbatch is different from the current number of partitions (<currNum>). There could be two possible reasons:

Option "numPartitions" of the rate source gets changed during query restart.
The size of the cluster might change during query restart.

Explicitly set option "numPartitions" of the rate source to <prevNum> to fix this issue.

Failed to communicate with streaming shuffle writer <writerId>.

STREAMING_SINK_DELIVERY_MODE

Invalid streaming sink delivery mode: <deliveryMode>.

For more details see STREAMING_SINK_DELIVERY_MODE

STREAMING_SKIP_OFFSETS_INVALID_RANGE

Invalid skip offset range: end offset <endOffset> is less than start offset <startOffset>. Fix this offset range and try again.

STREAMING_SOURCE_DEFINITION_CHANGED

The streaming query encountered a change in one or more of its source (such as the underlying table, view, or policy) during execution. This may result in incorrect or inconsistent data being read from the sources. Please restart the streaming query with a new dataframe to take latest version of sources.

STREAMING_STATEFUL_OPERATOR_MISSING_STATE_DIRECTORY

Cannot restart streaming query with stateful operators because the state directory is empty or missing.

This typically occurs when state files have been deleted or the streaming query was previously run without stateful operators but restarted with stateful operators.

Please remove the stateful operators, use a new checkpoint location, or restore the missing state files.

STREAMING_STATEFUL_OPERATOR_NOT_MATCH_IN_STATE_METADATA

Streaming stateful operator name does not match with the operator in state metadata. This likely to happen when user adds/removes/changes stateful operator of existing streaming query.

Stateful operators in the metadata: [<OpsInMetadataSeq>]; Stateful operators in current batch: [<OpsInCurBatchSeq>].

STREAMING_TABLE_NEEDS_REFRESH

streaming table <tableName> needs to be refreshed to execute <operation>.

If the table is created from DBSQL, please run REFRESH STREAMING TABLE.

If the table is created by a pipeline in Spark Declarative Pipelines on Lakeflow, please run a pipeline update.

STREAMING_TABLE_NOT_SUPPORTED

streaming tables can only be created and refreshed in Spark Declarative Pipelines on Lakeflow and Databricks SQL Warehouses.

STREAMING_TABLE_OPERATION_NOT_ALLOWED

The operation <operation> is not allowed:

For more details see STREAMING_TABLE_OPERATION_NOT_ALLOWED

STREAMING_TABLE_QUERY_INVALID

streaming table <tableName> can only be created from a streaming query. Please add the STREAM keyword to your FROM clause to turn this relation into a streaming query.

STREAMING_TIME_TRAVEL_SUPPORT_ERROR

The streaming query does not support time travel.

For more details see STREAMING_TIME_TRAVEL_SUPPORT_ERROR

STREAMING_UNRESUMABLE_CONTROL_BATCH_DETECTED

Unfinished control batch <batchId> cannot be resumed.

For more details see STREAMING_UNRESUMABLE_CONTROL_BATCH_DETECTED

STREAM_NOT_FOUND_FOR_KINESIS_SOURCE

SYNTAX_DISCONTINUED

Support of the clause or keyword: <clause> has been discontinued in this context.

For more details see SYNTAX_DISCONTINUED

TABLE_ACCESS_CONTROL_NOT_ENABLED

Trying to perform permission action on Hive Metastore <securables> but Table Access Control is not enabled on this cluster.

TABLE_ARGUMENTS_NOT_ALLOWED

TABLE parameters are not supported in <routineType>.

TABLE_NOT_VALID_INDEX

<tableName> is not a valid index. Provide a valid index name.

TABLE_OPERATION_REQUIRES_STANDARD_COMPUTE

Cannot <operation> <tableName> from Dedicated access mode or No Isolation compute. Use serverless compute, a Databricks SQL warehouse, or Standard access mode instead.

TABLE_OR_VIEW_ALREADY_EXISTS

Cannot create table or view <relationName> because it already exists.

Choose a different name, drop the existing object, add the IF NOT EXISTS clause to tolerate pre-existing objects, add the OR REPLACE clause to replace the existing materialized view, or add the OR REFRESH clause to refresh the existing streaming table.

TABLE_OR_VIEW_NOT_FOUND

The table or view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.

Search path: <searchPath>.

If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.

For more details see TABLE_OR_VIEW_NOT_FOUND

TABLE_TYPE_INCOMPATIBLE_WITH_ABAC_POLICY

The table type of <tableName>, <tableType>, does not support ABAC policies.

Please remove the policies and retry.

TABLE_VALUED_ARGUMENTS_NOT_YET_IMPLEMENTED_FOR_SQL_FUNCTIONS

Cannot <action> SQL user-defined function <functionName> with TABLE arguments because this functionality is not yet implemented.

TABLE_VALUED_FUNCTION_FAILED_TO_ANALYZE_IN_PYTHON

Failed to analyze the Python user defined table function: <msg>

TABLE_VALUED_FUNCTION_REQUIRED_METADATA_INCOMPATIBLE_WITH_CALL

Failed to evaluate the table function <functionName> because its table metadata <requestedMetadata>, but the function call <invalidFunctionCallProperty>.

TABLE_VALUED_FUNCTION_REQUIRED_METADATA_INVALID

Failed to evaluate the table function <functionName> because its table metadata was invalid; <reason>.

TABLE_VALUED_FUNCTION_TOO_MANY_TABLE_ARGUMENTS

SQLSTATE: 54023

There are too many table arguments for table-valued function.

It allows one table argument, but got: <num>.

If you want to allow it, please set "spark.sql.allowMultipleTableArguments.enabled" to "true"

TABLE_WITH_ID_NOT_FOUND

Table with ID <tableId> cannot be found. Verify the correctness of the UUID.

TASK_WRITE_FAILED

Task failed while writing rows to <path>.

TEMP_CHECKPOINT_LOCATION_NOT_SUPPORTED

Implicit temporary streaming checkpoint locations are not supported in the current workspace, please specify a checkpoint location explicitly.

For display(), set the checkpoint location using:

display(df, checkpointLocation = "your_path")

For all other streaming queries, use:

.option("checkpointLocation", "your_path").

TEMP_TABLE_CREATION_LEGACY_WITH_QUERY

CREATE TEMPORARY TABLE ... AS ... is not supported here, please use CREATE TEMPORARY VIEW instead

TEMP_TABLE_CREATION_MUTUAL_EXCLUSIVE_SPECS

To tolerate the error on drop use DROP TEMP TABLE IF EXISTS.

Error converting to FILE type. Use try_to_file() to skip this file and get a null value instead.

For more details see TO_FILE_ERROR

TO_FILE_READ_UNAUTHORIZED

User is not authorized to read the source file at path <path>. Use try_to_file() to skip these files and get a null value instead.

TRAILING_COMMA_IN_SELECT

Trailing comma detected in SELECT clause. Remove the trailing comma before the FROM clause.

TRANSACTION_CDF_SCHEMA_WITH_RESERVED_COLUMN_NAME

Change Data Feed cannot be enabled in a transaction because a table contains a reserved column name (<column_name>).

To proceed, make sure the table uses only non-reserved column names.

TRANSACTION_CDF_SETTING_HIGH_WATERMARK_NOT_ALLOWED

Manually setting the CDC Identities high watermark is not allowed.

TRANSACTION_CONCURRENT_CATALOG_METADATA_CHANGE

A concurrent metadata change has been detected on object <table>. Run ROLLBACK and then retry this transaction. Details:

For more details see TRANSACTION_CONCURRENT_CATALOG_METADATA_CHANGE

TRANSACTION_CONCURRENT_COPY_INTO

Concurrent COPY INTO operation detected on the table <tableName>. Retry the transaction.

Conflicting commit: <conflictingCommit>

TRANSACTION_CONTEXT_MISMATCH

Transaction context inconsistency was detected between the current thread and the Spark session. This typically occurs when a Spark session is shared across multiple threads. Please use a dedicated session and thread for each transaction, and commit/rollback the transaction in its thread before reusing the session and thread for a new transaction. Details:

For more details see TRANSACTION_CONTEXT_MISMATCH

TRANSACTION_MAX_COMMIT_TIMESTAMP_EXCEEDED

Transaction cannot commit as max commit timestamp is exceeded. maxCommitTimestamp:<maxCommitTimestampMs> commitTimestamp:<commitTimestampMs>

TRANSACTION_NOT_SUPPORTED

Failed to execute the statement.

For more details see TRANSACTION_NOT_SUPPORTED

TRANSACTION_ROLLBACK_REQUIRED_AFTER_ABORT

The current transaction has been aborted. Please run ROLLBACK TRANSACTION before continuing. Abort reason:

For more details see TRANSACTION_ROLLBACK_REQUIRED_AFTER_ABORT

TRANSFORM_WITH_STATE_USER_FUNCTION_ERROR

An error occurred in the user-defined function <function> of the StatefulProcessor. Reason: <reason>.

TRANSPOSE_EXCEED_ROW_LIMIT

SQLSTATE: 54006

Number of rows exceeds the allowed limit of <maxValues> for TRANSPOSE. If this was intended, set <config> to at least the current row count.

TRANSPOSE_INVALID_INDEX_COLUMN

SQLSTATE: 42804

Invalid index column for TRANSPOSE because: <reason>

TRANSPOSE_NO_LEAST_COMMON_TYPE

Transpose requires non-index columns to share a least common type, but <dt1> and <dt2> do not.

TRIGGER_INTERVAL_INVALID

The trigger interval must be a positive duration that can be converted into whole seconds. Received: <actual> seconds.

TRUNCATE_PARTITIONS_NOT_SUPPORTED

Truncating partitions is not supported.

TRUNCATE_PARTITION_NOT_SUPPORTED

Truncating partition is not supported.

TUPLE_INVALID_INPUT_SKETCH_BUFFER

Invalid call to <function>; only valid Tuple sketch buffers are supported as inputs (such as those produced by the corresponding tuple_sketch_agg_* function).

TUPLE_INVALID_INPUT_SKETCH_BUFFER_FAMILY

Invalid call to <function>: expected <expectedFamily> sketch family but received <actualFamily>. Only valid Tuple sketch buffers (produced by tuple_sketch_agg_* functions) are supported as inputs.

TUPLE_INVALID_SKETCH_MODE

Invalid call to <function>: mode '<mode>' is not supported. Valid modes are: <validModes>.

TUPLE_IS_EMPTY

SQLSTATE: 22004

Due to Scala's limited support of tuple, empty tuple is not supported.

TUPLE_SIZE_EXCEEDS_LIMIT

SQLSTATE: 54011

Due to Scala's limited support of tuple, tuples with more than 22 elements are not supported.

UC_BUCKETED_TABLES

Bucketed tables are not supported in Unity Catalog.

UC_CATALOG_NAME_NOT_PROVIDED

SQLSTATE: 3D000

For Unity Catalog, please specify the catalog name explicitly. E.g. SHOW GRANT your.address@email.com ON CATALOG main.

UC_COMMAND_NOT_SUPPORTED

The command(s): <commandName> are not supported in Unity Catalog.

For more details see UC_COMMAND_NOT_SUPPORTED

UC_COMMAND_NOT_SUPPORTED_IN_SERVERLESS

The command(s): <commandName> are not supported for Unity Catalog clusters in serverless. Use single user or shared clusters instead.

UC_COMMAND_NOT_SUPPORTED_IN_SHARED_ACCESS_MODE

The command(s): <commandName> are not supported for Unity Catalog clusters in shared access mode. Use single user access mode instead.

UC_CONNECTION_ACCESS_FAILED

Could not access the UC connection '<connectionName>'. Verify that the connection exists and the current user has adequate permissions to access it.

UC_CONNECTION_CHECK_FAILED

<errorMessage>

UC_EXTERNAL_VOLUME_MISSING_LOCATION

LOCATION clause must be present for external volume. Please check the syntax 'CREATE EXTERNAL VOLUME ... LOCATION ...' for creating an external volume.

UC_FAILED_PROVISIONING_STATE

The query failed because it attempted to refer to table <tableName> but was unable to do so: <failureReason>. Please update the table <tableName> to ensure it is in an Active provisioning state and then retry the query again.

UC_FILE_SCHEME_FOR_TABLE_CREATION_NOT_SUPPORTED

Creating table in Unity Catalog with file scheme <schemeName> is not supported.

Instead, please create a federated data source connection using the CREATE CONNECTION command for the same table provider, then create a catalog based on the connection with a CREATE FOREIGN CATALOG command to reference the tables therein.

UC_FLOWS_NOT_SUPPORTED

Flows are not supported in Unity Catalog.

UC_HIVE_METASTORE_DISABLED_EXCEPTION

The operation attempted to use Hive Metastore<identifier>, which is disabled due to legacy access being turned off in your account or workspace. Please double check the default catalog in current session and default namespace setting. If you need to access the Hive Metastore, please ask your admin to set up Hive Metastore federation through Unity Catalog.

UC_HIVE_METASTORE_FEDERATION_CROSS_CATALOG_VIEW_NOT_SUPPORTED

Hive Metastore Federation view does not support dependencies across multiple catalogs. View <view> in Hive Metastore Federation catalog must use dependency from hive_metastore or spark_catalog catalog but its dependency <dependency> is in another catalog <referencedCatalog>. Please update the dependencies to satisfy this constraint and then retry your query or command again.

UC_HIVE_METASTORE_FEDERATION_NOT_ENABLED

Hive Metastore federation is not enabled on this cluster.

Accessing the catalog <catalogName> is not supported on this cluster

UC_INVALID_DEPENDENCIES

UC_SECRETS_NOT_ENABLED

Support for Unity Catalog Secrets is not enabled.

UC_SECRET_ALREADY_EXISTS

UC_VOLUME_FGAC_NOT_ENABLED

Unity Catalog Volume fine-grained access control is not available on this instance.

UC_VOLUME_NOT_FOUND

Volume <name> does not exist. Please use 'SHOW VOLUMES' to list available volumes.

UDF_ENVIRONMENT_ERROR

Failed to install UDF dependencies for <udfName> due to a system error.

For more details see UDF_ENVIRONMENT_ERROR

UDF_ENVIRONMENT_USER_ERROR

Failed to install UDF dependencies for <udfName>.

For more details see UDF_ENVIRONMENT_USER_ERROR

UDF_ERROR

Execution of function <fn> failed

For more details see UDF_ERROR

UDF_LIMITS

SQLSTATE: 54KD0

One or more UDF limits were breached.

For more details see UDF_LIMITS

UDF_MAX_COUNT_EXCEEDED

SQLSTATE: 54KD0

Exceeded query-wide UDF limit of <maxNumUdfs> UDFs (limited during public preview). Found <numUdfs>. The UDFs were: <udfNames>.

UDF_PYSPARK_ERROR

Python worker exited unexpectedly

For more details see UDF_PYSPARK_ERROR

UDF_PYSPARK_UNSUPPORTED_TYPE

PySpark UDF <udf> (<eval-type>) is not supported on clusters in Shared access mode.

UDF_PYSPARK_USER_CODE_ERROR

Execution failed.

For more details see UDF_PYSPARK_USER_CODE_ERROR

UDF_UNSUPPORTED_PARAMETER_DEFAULT_VALUE

Parameter default value is not supported for user-defined <functionType> function.

UDF_USER_CODE_ERROR

The request does not have valid authentication credentials for the operation.

UNAUTHORIZED_ACCESS

Unauthorized access:

<report>

UNBOUND_SQL_PARAMETER

SQLSTATE: 42P02

Found the unbound parameter: <name>. Please, fix args and provide a mapping of the parameter to either a SQL literal or collection constructor functions such as map(), array(), struct().

UNCLOSED_BRACKETED_COMMENT

Found an unclosed bracketed comment. Please, append */ at the end of the comment.

UNEXPECTED_INPUT_TYPE

Parameter <paramIndex> of function <functionName> requires the <requiredType> type, however <inputSql> has the type <inputType>.

UNEXPECTED_INPUT_TYPE_OF_NAMED_PARAMETER

The <namedParamKey> parameter of function <functionName> requires the <requiredType> type, however <inputSql> has the type <inputType>.<hint>

UNEXPECTED_OPERATOR_IN_STREAMING_VIEW

SQLSTATE: 42KDD

Unexpected operator <op> in the CREATE VIEW statement as a streaming source.

A streaming view query must consist only of SELECT, WHERE, and UNION ALL operations.

UNEXPECTED_POSITIONAL_ARGUMENT

Cannot invoke routine <routineName> because it contains positional argument(s) following the named argument assigned to <parameterName>; please rearrange them so the positional arguments come first and then retry the query again.

UNEXPECTED_SERIALIZER_FOR_CLASS

The class <className> has an unexpected expression serializer. Expects "STRUCT" or "IF" which returns "STRUCT" but found <expr>.

UNION_NOT_SUPPORTED_IN_RECURSIVE_CTE

SQLSTATE: 42836

The UNION operator is not yet supported within recursive common table expressions (WITH clauses that refer to themselves, directly or indirectly). Please use UNION ALL instead.

UNIQUE_CONSTRAINT_DISABLED

Unique constraint feature is disabled. To enable it, set "spark.databricks.sql.dsv2.unique.enabled" as true.

UNKNOWN_FIELD_EXCEPTION

Encountered <changeType> during parsing: <unknownFieldBlob>, which can be fixed by an automatic retry: <isRetryable>

For more details see UNKNOWN_FIELD_EXCEPTION

UNKNOWN_POSITIONAL_ARGUMENT

The invocation of routine <routineName> contains an unknown positional argument <sqlExpr> at position <pos>. This is invalid.

UNKNOWN_PRIMITIVE_TYPE_IN_VARIANT

Unknown primitive type with id <id> was found in a variant value.

UNKNOWN_PROTOBUF_MESSAGE_TYPE

SQLSTATE: 42K0G

Attempting to treat <descriptorName> as a Message, but it was <containingType>.

UNPIVOT_REQUIRES_ATTRIBUTES

SQLSTATE: 42K0A

UNPIVOT requires all given <given> expressions to be columns when no <empty> expressions are given. These are not columns: [<expressions>].

UNPIVOT_REQUIRES_VALUE_COLUMNS

SQLSTATE: 42K0A

At least one value column needs to be specified for UNPIVOT, all columns specified as ids.

UNPIVOT_VALUE_DATA_TYPE_MISMATCH

Unpivot value columns must share a least common type, some types do not: [<types>].

UNPIVOT_VALUE_SIZE_MISMATCH

SQLSTATE: 428C4

All unpivot value columns must have the same size as there are value column names (<names>).

UNRECOGNIZED_PARAMETER_NAME

Cannot invoke routine <routineName> because the routine call included a named argument reference for the argument named <argumentName>, but this routine does not include any signature containing an argument with this name. Did you mean one of the following? [<proposal>].

UNRECOGNIZED_SQL_TYPE

Unrecognized SQL type - name: <typeName>, id: <jdbcType>.

UNRECOGNIZED_STATISTIC

The statistic <stats> is not recognized. Valid statistics include count, count_distinct, approx_count_distinct, mean, stddev, min, max, and percentile values. Percentile must be a numeric value followed by '%', within the range 0% to 100%.

UNRESOLVABLE_TABLE_VALUED_FUNCTION

Could not resolve <name> to a table-valued function.

Please make sure that <name> is defined as a table-valued function and that all required parameters are provided correctly.

If <name> is not defined, please create the table-valued function before using it.

For more information about defining table-valued functions, please refer to the Apache Spark documentation.

UNRESOLVED_ALL_IN_GROUP_BY

Cannot infer grouping columns for GROUP BY ALL based on the select clause. Please explicitly specify the grouping columns.

UNRESOLVED_COLUMN

A column, variable, or function parameter with name <objectName> cannot be resolved.

For more details see UNRESOLVED_COLUMN

SQLSTATE: 42K0S

Invalid call to <method> on an unresolved named expression.

UNRESOLVED_ROUTINE

Cannot resolve routine <routineName> on search path <searchPath>.

Verify the spelling of <routineName>, check that the routine exists, and confirm you have USE privilege on the catalog and schema, and EXECUTE on the routine.

For more details see UNRESOLVED_ROUTINE

UNRESOLVED_TABLE_PATH

Storage path for table <identifier> cannot be resolved.

UNRESOLVED_UC_SECRET_REFERENCE

UC Secret reference <secretName> was not resolved during analysis. UC Secret references must be resolved and replaced before query execution.

UNRESOLVED_USING_COLUMN_FOR_JOIN

USING column <colName> cannot be resolved on the <side> side of the join. The <side>-side columns: [<suggestion>].

UNRESOLVED_VARIABLE

Cannot resolve variable <variableName> on search path <searchPath>.

UNSTRUCTURED_DATA_PROCESSING_UNSUPPORTED_FILE_FORMAT

Unstructured file format <format> is not supported. Supported file formats are <supportedFormats>.

Please update the format from your <expr> expression to one of the supported formats and then retry the query again.

UNSTRUCTURED_DATA_PROCESSING_UNSUPPORTED_MODEL_OPTION

Unstructured model option ('<option>' -> '<value>') is not supported. Supported values are: <supportedValues>.

Switch to one of the supported values and then retry the query again.

Please put them into a single external location.

UNSUPPORTED_CONNECT_FEATURE

Cannot create generated column <fieldName> with generation expression <expressionStr> because <reason>.

UNSUPPORTED_EXPR_FOR_OPERATOR

The query operator <operator> contains one or more unsupported expressions.

Consider to rewrite it to avoid window functions, aggregate functions, and generator functions in the <operator> operator.

Invalid expressions: [<invalidExprSqls>]

UNSUPPORTED_EXPR_FOR_PARAMETER

A query parameter contains unsupported expression.

Parameters can either be variables or literals.

Invalid expression: [<invalidExprSql>]

UNSUPPORTED_EXPR_FOR_WINDOW

SQLSTATE: 42P20

Expression <sqlExpr> not supported within a window function.

UNSUPPORTED_FEATURE

The feature is not supported:

For more details see UNSUPPORTED_FEATURE

The Hive Parquet SerDe does not support this data type for table <tableName>.

For more details see UNSUPPORTED_HIVE_PARQUET_TYPE

UNSUPPORTED_HIVE_TABLE_READ_ON_DBSQL

Reading Hive table '<identifier>' with SerDe '<serde>', input format '<inputFormat>', and output format '<outputFormat>' is not allowed on Databricks SQL. Only <allowlist> data sources are supported.

If you have to read the table on Databricks SQL, we recommend converting the table into a new table of Delta format in a Databricks notebook with query 'CREATE TABLE TableName USING DELTA AS SELECT * FROM <identifier>'

UNSUPPORTED_HIVE_TYPE

Cannot read the Hive type <fieldType> of the column <fieldName> because Spark SQL does not support this data type.

UNSUPPORTED_INITIAL_POSITION_AND_TRIGGER_PAIR_FOR_KINESIS_SOURCE

<trigger> with initial position <initialPosition> is not supported with the Kinesis source

UNSUPPORTED_INSERT

Can't insert into the target.

For more details see UNSUPPORTED_INSERT

UNSUPPORTED_INSERT_WITH_SCHEMA_EVOLUTION

INSERT WITH SCHEMA EVOLUTION ... is unsupported for this table format.

The operation <operation> is not supported for ContinuousMemorySink.

UNSUPPORTED_OVERWRITE

SQLSTATE: 42902

Can't overwrite the target that is also being read from.

For more details see UNSUPPORTED_OVERWRITE

UNSUPPORTED_PARTITION_TRANSFORM

Unsupported partition transform: <transform>. The supported transforms are identity, bucket, and clusterBy. Ensure your transform expression uses one of these.

UNSUPPORTED_PIPELINE_SPARK_SQL_COMMAND

'<command>' is not supported in spark.sql("...") API in Lakeflow pipeline.

The single-pass analyzer cannot process this query or command because it does not yet support <feature>.

UNSUPPORTED_SQL_UDF_USAGE

Using SQL function <functionName> in <nodeName> is not supported.

UNSUPPORTED_STREAMING_OPERATOR_WITHOUT_WATERMARK

<outputMode> output mode not supported for <statefulOperator> on streaming DataFrames/DataSets without watermark.

UNSUPPORTED_STREAMING_OPTIONS_FOR_VIEW

The function <function> uses an unsupported feature.

For more details see UNSUPPORTED_UDF_FEATURE

UNSUPPORTED_UDF_TYPES_IN_SAME_PLACE

UDF types cannot be used together: <types>

UNTYPED_SCALA_UDF

You're using untyped Scala UDF, which does not have the input type information.

Spark may blindly pass null to the Scala closure with primitive-type argument, and the closure will see the default value of the Java type for the null argument, for example, udf((x: Int) => x, IntegerType), the result is 0 for null input. To get rid of this error, you could:

use typed Scala UDF APIs(without return type parameter), for example, udf((x: Int) => x).
use Java UDF APIs, for example, udf(new UDF1[String, Integer] { override def call(s: String): Integer = s.length() }, IntegerType), if input types are all non primitive.
set "spark.sql.legacy.allowUntypedScalaUDF" to "true" and use this API with caution.

UPGRADE_NOT_SUPPORTED

Table is not eligible for upgrade from Hive Metastore to Unity Catalog. Reason:

For more details see UPGRADE_NOT_SUPPORTED

USER_DEFINED_FUNCTIONS

User defined function is invalid:

For more details see USER_DEFINED_FUNCTIONS

USER_HOME_CATALOG_NOT_FOUND_EXCEPTION

SQLSTATE: none assigned

Failed to execute the USER_HOME_CATALOG SQL function because the user home catalog cannot be found. Please reach out to your workspace admin to enable this feature, validate your user home catalog exists in the Catalog Explorer and retry the command.

USER_RAISED_EXCEPTION

SQLSTATE: P0001

<errorMessage>

USER_RAISED_EXCEPTION_PARAMETER_MISMATCH

SQLSTATE: P0001

The raise_error() function was used to raise error class: <errorClass> which expects parameters: <expectedParms>.

The provided parameters <providedParms> do not match the expected parameters.

Please make sure to provide all expected parameters.

USER_RAISED_EXCEPTION_UNKNOWN_ERROR_CLASS

SQLSTATE: P0001

The raise_error() function was used to raise an unknown error class: <errorClass>

USER_SPECIFIED_AND_ACTUAL_SCHEMA_MISMATCH

The user-specified schema doesn't match the actual schema:

user-specified: <schema>, actual: <actualSchema>. If you're using

DataFrameReader.schema API or creating a table, please do not specify the schema.

Or if you're scanning an existed table, please drop it and re-create it.

USER_SPECIFIED_AND_INFERRED_SCHEMA_NOT_COMPATIBLE

Table '<tableName>' has a user-specified schema that is incompatible with the schema

inferred from its query.

<streamingTableHint>

Declared schema:

<specifiedSchema>

VARIABLE_NOT_FOUND

The variable <variableName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VARIABLE IF EXISTS.

VARIANT_CONSTRUCTOR_SIZE_LIMIT

Cannot construct a Variant larger than 16 MiB. The maximum allowed size of a Variant value is 16 MiB.

VARIANT_DUPLICATE_KEY

Failed to build variant because of a duplicate object key <key>.

VARIANT_PATH_TYPE_MISMATCH

The path '<path>' is incompatible with the variant value at '<failedAt>' in <functionName>.

VARIANT_SIZE_LIMIT

Cannot build variant bigger than <sizeLimit> in <functionName>.

Please avoid large input strings to this expression (for example, add function calls(s) to check the expression size and convert it to NULL first if it is too big).

VECTOR_DIMENSION_MISMATCH

Vectors passed to <functionName> must have the same dimension, but got <leftDim> and <rightDim>.

VECTOR_INDEX_CORRUPT_METADATA

Cannot read metadata for vector index <indexName>. Drop the index and recreate it.

For more details see VECTOR_INDEX_CORRUPT_METADATA

VECTOR_INDEX_INVALID_PARAMETER

Cannot create vector index due to an invalid parameter, table, or column configuration.

For more details see VECTOR_INDEX_INVALID_PARAMETER

VECTOR_INDEX_NAME_CONFLICTS_WITH_TABLE

A table with name <indexName> already exists. Provide a custom index name that does not conflict with existing tables.

VERSIONED_CLONE_LATEST_TARGET_VERSION_GREATER_THAN_LATEST_SOURCE_VERSION

Target version <latestTargetVersion> is greater than source version <latestSourceVersion>.

VERSIONED_CLONE_OVERLAPPING_ICEBERG_PATHS

Source path '<sourcePath>' and target path '<targetPath>' overlap. Cloning requires non-overlapping paths.

VERSIONED_CLONE_SOURCE_TABLE_CHANGED

Source table was replaced between clone attempts. Expected source UC table ID <expectedId> but found <actualId>.

VERSIONED_CLONE_UNSUPPORTED_FEATURE

Versioned Clone encountered an unsupported feature:

For more details see VERSIONED_CLONE_UNSUPPORTED_FEATURE

VERSIONED_CLONE_UNSUPPORTED_TABLE_FEATURE

The source table history contains table feature(s) not supported by versioned clone in this DBR version: <unsupportedFeatureNames>.

Please upgrade to a newer DBR version.

VIEW_ALREADY_EXISTS

Cannot create view <relationName> because it already exists.

Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.

VIEW_EXCEED_MAX_NESTED_DEPTH

SQLSTATE: 54K00

The depth of view <viewName> exceeds the maximum view resolution depth (<maxNestedDepth>).

Analysis is aborted to avoid errors. If you want to work around this, please try to increase the value of "spark.sql.view.maxNestedViewDepth".

VIEW_NOT_FOUND

The view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VIEW IF EXISTS.

VIEW_WRITE_NOT_ALLOWED

Cannot write into view <name>, please write into a table instead.

VOLUME_ALREADY_EXISTS

Cannot create volume <relationName> because it already exists.

Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.

WATERMARK_ADVANCEMENT_STRATEGY

Error parsing WKB: <parseError> at position <pos>

For more details see WKB_PARSE_ERROR

WRITE_STREAM_NOT_ALLOWED

writeStream can be called only on streaming Dataset/DataFrame.

WRONG_COLUMN_DEFAULTS_FOR_DELTA_ALTER_TABLE_ADD_COLUMN_NOT_SUPPORTED

Failed to execute the command because DEFAULT values are not supported when adding new

columns to previously existing Delta tables; please add the column without a default

value first, then run a second ALTER TABLE ALTER COLUMN SET DEFAULT command to apply

for future inserted rows instead.

WRONG_COLUMN_DEFAULTS_FOR_DELTA_FEATURE_NOT_ENABLED

Failed to execute <commandType> command because it assigned a column DEFAULT value,

but the corresponding table feature was not enabled. Please retry the command again

after executing ALTER TABLE tableName SET

TBLPROPERTIES('delta.feature.allowColumnDefaults' = 'supported').

WRONG_COMMAND_FOR_OBJECT_TYPE

The operation <operation> requires a <requiredType>. But <objectName> is a <foundType>. Use <alternative> instead.

WRONG_NUM_ARGS

SQLSTATE: 42605

The <functionName> requires <expectedNum> parameters but the actual number is <actualNum>.

For more details see WRONG_NUM_ARGS

XML_ROW_TAG_MISSING

<rowTag> option is required for reading/writing files in XML format.

XML_UNSUPPORTED_NESTED_TYPES

SQLSTATE: 0N000

XML doesn't support <innerDataType> as inner type of <dataType>. Please wrap the <innerDataType> within a StructType field when using it inside <dataType>.

XML_WILDCARD_RESCUED_DATA_CONFLICT_ERROR

Rescued data and wildcard column cannot be simultaneously enabled. Remove the wildcardColumnName option.

ZIP_PLANS_NOT_MERGEABLE

The two DataFrames in zip() cannot be merged. They must produce the same canonicalized plan after stripping outer Project chains, and must not contain non-scalar Python UDFs.

ZORDERBY_COLUMN_DOES_NOT_EXIST

ALTER TABLE ... SET MANAGED requires COPY or MOVE to be specified for foreign table <table>.

DELTA_ALTER_TABLE_SET_MANAGED_DOES_NOT_SUPPORT_UNIFORM_ICEBERG

ALTER TABLE ... SET MANAGED does not support Uniform Apache Iceberg table. Disable Uniform or use SET MANAGED TRUNCATE UNIFORM HISTORY.

DELTA_ALTER_TABLE_SET_MANAGED_FAILED

ALTER TABLE <table> SET MANAGED failed.

For more details see DELTA_ALTER_TABLE_SET_MANAGED_FAILED

DELTA_ALTER_TABLE_SET_MANAGED_NOT_ENABLED

ALTER TABLE ... SET MANAGED command is not enabled. Contact your Databricks support team for assistance.

DELTA_ALTER_TABLE_SET_MANAGED_TABLE_NOT_MIGRATABLE

ALTER TABLE <table> SET MANAGED is unable to migrate the given table.

Make sure the table is in a valid state and retry the command. If the issue persists, contact Databricks support.

For more details see DELTA_ALTER_TABLE_SET_MANAGED_TABLE_NOT_MIGRATABLE

DELTA_ALTER_TABLE_SET_MANAGED_UNSUPPORTED_COPY_MOVE_SYNTAX

ALTER TABLE ... SET MANAGED [COPY | MOVE] syntax is not supported for table <table>. Use ALTER TABLE ... SET MANAGED instead.

DELTA_ALTER_TABLE_SET_MANAGED_UNSUPPORTED_FOREIGN_TABLE

Foreign table <table> is not supported for migrating to UC managed table: <errorMessage>.

DELTA_ALTER_TABLE_UNSET_MANAGED_DOES_NOT_SUPPORT_CATALOG_OWNED

ALTER TABLE ... UNSET MANAGED does not support tables with the Catalog-Owned (catalogManaged) feature enabled.

Drop the Catalog-Owned feature using ALTER TABLE ... DROP FEATURE catalogManaged before running this command.

DELTA_ALTER_TABLE_UNSET_MANAGED_DOES_NOT_SUPPORT_COMPATIBILITY_MODE

ALTER TABLE ... UNSET MANAGED does not support table with compatibility mode enabled.

Disable compatibility mode on the table before running this command.

DELTA_ALTER_TABLE_UNSET_MANAGED_DOES_NOT_SUPPORT_UNIFORM

ALTER TABLE ... UNSET MANAGED does not support Uniform. Disable Uniform or use UNSET MANAGED TRUNCATE UNIFORM HISTORY.

DELTA_ALTER_TABLE_UNSET_MANAGED_FAILED

<table> cannot be rolled back from managed to external table.

For more details see DELTA_ALTER_TABLE_UNSET_MANAGED_FAILED

DELTA_ALTER_TABLE_UNSET_MANAGED_NOT_ENABLED

ALTER TABLE ... UNSET MANAGED command is not enabled. Contact your Databricks support team for assistance.

DELTA_AMBIGUOUS_DATA_TYPE_CHANGE

Cannot change data type of <column> from <from> to <to>. This change contains column removals and additions, therefore they are ambiguous. Please make these changes individually using ALTER TABLE [ADD | DROP | RENAME] COLUMN.

DELTA_AMBIGUOUS_PARTITION_COLUMN

Ambiguous partition column <column> can be <colMatches>.

DELTA_AMBIGUOUS_PATHS_IN_CREATE_TABLE

CREATE TABLE contains two different locations: <identifier> and <location>.

You can remove the LOCATION clause from the CREATE TABLE statement, or set

<config> to true to skip this check.

DELTA_ARCHIVED_FILES_IN_LIMIT

SQLSTATE: 42KDC

Table <table> does not contain enough records in non-archived files to satisfy specified LIMIT of <limit> records.

Only <numRecords> record(s) were found in non-archived files.

Retry with a lower LIMIT. If you didn't set one, add an explicit LIMIT clause to override the default.

DELTA_ARCHIVED_FILES_IN_SCAN

SQLSTATE: 42KDC

Found <numArchivedFiles> potentially archived file(s) in table <table> that need to be scanned as part of this query.

Archived files cannot be accessed. The current time until archival is configured as <archivalTime>.

Please adjust your query filters to exclude any archived files.

DELTA_BLOCKED_WRITE_WITH_DROPPED_NULLTYPE

Write with schema evolution from a Delta table that contains NullType columns is not supported. Upgrade to a newer Databricks Runtime version.

DELTA_BLOCK_COLUMN_MAPPING_AND_CDC_OPERATION

Operation "<opName>" is not allowed when the table has enabled change data feed (CDF) and has undergone schema changes using DROP COLUMN or RENAME COLUMN.

DELTA_BLOOM_FILTER_DROP_ON_NON_EXISTING_COLUMNS

Cannot drop bloom filter indices for the following non-existent column(s): <unknownColumns>.

DELTA_BLOOM_FILTER_INVALID_PARAMETER_VALUE

Cannot create bloom filter index, invalid parameter value: '<message>'.

DELTA_BLOOM_FILTER_OOM_ON_WRITE

SQLSTATE: 82100

OutOfMemoryError occurred while writing bloom filter indices for the following column(s): <columnsWithBloomFilterIndices>.

You can reduce the memory footprint of bloom filter indices by choosing a smaller value for the 'numItems' option, a larger value for the 'fpp' option, or by indexing fewer columns.

DELTA_CANNOT_CHANGE_DATA_TYPE

Cannot change data type: <dataType>.

DELTA_CANNOT_CHANGE_LOCATION

Cannot change the 'location' of the Delta table using SET TBLPROPERTIES. Please use ALTER TABLE SET LOCATION instead.

DELTA_CANNOT_CHANGE_PROVIDER

'provider' is a reserved table property, and cannot be altered.

DELTA_CANNOT_CREATE_BLOOM_FILTER_NON_EXISTING_COL

Cannot create bloom filter indices for the following non-existent column(s): <unknownCols>.

DELTA_CANNOT_CREATE_LOG_PATH

SQLSTATE: 42KD5

Cannot create <path>.

DELTA_CANNOT_DESCRIBE_VIEW_HISTORY

Cannot describe the history of a view.

DELTA_CANNOT_DROP_BLOOM_FILTER_ON_NON_INDEXED_COLUMN

Cannot drop bloom filter index on a non indexed column: <columnName>.

DELTA_CANNOT_DROP_CHECK_CONSTRAINT_FEATURE

Cannot drop the CHECK constraints table feature.

The following constraints must be dropped first: <constraints>.

DELTA_CANNOT_DROP_COLLATIONS_FEATURE

DELTA_CANNOT_OVERRIDE_COORDINATED_COMMITS_CONFS

<Command> cannot override coordinated commits configurations for an existing target table. Please remove them ("delta.coordinatedCommits.commitCoordinator-preview", "delta.coordinatedCommits.commitCoordinatorConf-preview", "delta.coordinatedCommits.tableConf-preview") from the TBLPROPERTIES clause and then retry the command again.

DELTA_CANNOT_RECONSTRUCT_PATH_FROM_URI

A uri (<uri>) which can't be turned into a relative path was found in the transaction log.

DELTA_CANNOT_RELATIVIZE_PATH

SQLSTATE: 428FT

Cannot use all columns for partition columns.

DELTA_CANNOT_VACUUM_LITE

VACUUM LITE cannot delete all eligible files as some files are not referenced by the Delta log. Please run VACUUM FULL.

DELTA_CANNOT_WRITE_EMPTY_SCHEMA

The Delta table is not writable because parts of the schema are not supported.

Reason:

For more details see DELTA_CANNOT_WRITE_EMPTY_SCHEMA

DELTA_CANNOT_WRITE_INTO_VIEW

<table> is a view. Writes to a view are not supported.

DELTA_CAST_OVERFLOW_IN_TABLE_WRITE

Failed to write a value of <sourceType> type into the <targetType> type column <columnName> due to an overflow.

Use try_cast on the input value to tolerate overflow and return NULL instead.

If necessary, set <storeAssignmentPolicyFlag> to "LEGACY" to bypass this error or set <updateAndMergeCastingFollowsAnsiEnabledFlag> to true to revert to the old behaviour and follow <ansiEnabledFlag> in UPDATE and MERGE.

DELTA_CATALOG_MANAGED_TABLE_UPGRADE_OR_DOWNGRADE_NOT_SUPPORTED

Upgrading or downgrading a catalog‑managed table is not supported. Create a new table with the desired table features instead.

DELTA_CATALOG_MANAGED_TABLE_UPGRADE_WITH_OTHER_PROPERTIES

File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This request appears to be targeting Change Data Feed, if that is the case, this error can occur when the change data file is out of the retention period and has been deleted by the VACUUM statement. For more information, see <faqPath>

DELTA_CHANGE_TABLE_FEED_DISABLED

SQLSTATE: 42807

Cannot write to table with delta.enableChangeDataFeed set. Change data feed from Delta is not available.

DELTA_CHECKPOINT_NON_EXIST_TABLE

Cannot checkpoint a non-existing table <path>. Did you manually delete files in the _delta_log directory?

DELTA_CLONE_AMBIGUOUS_TARGET

Two paths were provided as the CLONE target so it is ambiguous which to use. An external

location for CLONE was provided at <externalLocation> at the same time as the path

<targetIdentifier>.

DELTA_CLONE_INCOMPATIBLE_SOURCE

The clone source has valid format, but has unsupported feature with Delta.

For more details see DELTA_CLONE_INCOMPATIBLE_SOURCE

DELTA_CLONE_INCOMPLETE_FILE_COPY

File (<fileName>) not copied completely. Expected file size: <expectedSize>, found: <actualSize>. To continue with the operation by ignoring the file size check set <config> to false.

DELTA_CLONE_PARQUET_SOURCE_AMBIGUOUS_FILES_WITH_SAME_PATH

Cannot DEEP CLONE: source and target have files at the same path with different sizes (showing up to 5): <paths>.

This occurs when source data location changes while reusing file names. Use unique file names (recommended) or drop and recreate the target table.

DELTA_CLONE_UNSUPPORTED_SOURCE

Unsupported <mode> clone source '<name>', whose format is <format>.

The supported formats are 'delta', 'Apache Iceberg' and 'parquet'.

DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_SOURCE

Unsupported source table:

For more details see DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_SOURCE

DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_TARGET

Unsupported target table:

For more details see DELTA_CLONE_WITH_HISTORY_UNSUPPORTED_TARGET

DELTA_CLONE_WITH_ROW_TRACKING_WITHOUT_STATS

Cannot shallow clone a table without statistics and with row tracking enabled.

If you want to enable row tracking you need to first collect statistics on the source table by running:

ANALYZE TABLE table_name COMPUTE DELTA STATISTICS

DELTA_CLUSTERING_CANNOT_DISABLE_VARIANT_SHREDDING

Cannot disable variant shredding (table property '<tableProperty>') because this table uses variant clustering expressions. Remove the variant clustering first with ALTER TABLE ... CLUSTER BY before disabling variant shredding.

DELTA_CLUSTERING_CLONE_TABLE_NOT_SUPPORTED

CLONE is not supported for Delta table with Liquid clustering for DBR version < 14.0.

DELTA_CLUSTERING_COLUMNS_DATATYPE_NOT_SUPPORTED

CLUSTER BY is not supported because the following column(s): <columnsWithDataTypes> don't support data skipping.

DELTA_CLUSTERING_COLUMNS_MISMATCH

The provided clustering columns do not match the existing table's.

provided: <providedClusteringColumns>
existing: <existingClusteringColumns>

DELTA_CLUSTERING_COLUMN_MISSING_STATS

Liquid clustering requires clustering columns to have stats. Couldn't find clustering column(s) '<columns>' in stats schema:

<schema>

DELTA_CLUSTERING_CREATE_EXTERNAL_NON_LIQUID_TABLE_FROM_LIQUID_TABLE

Creating an external table without liquid clustering from a table directory with liquid clustering is not allowed; path: <path>.

DELTA_CLUSTERING_EXPRESSION_REQUIRES_STATS

Clustering on the expression '<expression>' is not supported when clustering-expression stats collection is disabled. Set '<collectConfigKey>' and '<clusteringConfigKey>' to 'true', or cluster on the column without a transform instead.

DELTA_CLUSTERING_NOT_SUPPORTED

'<operation>' does not support clustering.

DELTA_CLUSTERING_PHASE_OUT_FAILED

Cannot finish the <phaseOutType> of the table with <tableFeatureToAdd> table feature (reason: <reason>). Please try the OPTIMIZE command again.

== Error ==

<error>

DELTA_CLUSTERING_REPLACE_TABLE_WITH_PARTITIONED_TABLE

REPLACE a Delta table with Liquid clustering with a partitioned table is not allowed.

DELTA_CLUSTERING_SHOW_CREATE_TABLE_WITHOUT_CLUSTERING_COLUMNS

SHOW CREATE TABLE is not supported for Delta table with Liquid clustering without any clustering columns.

DELTA_CLUSTERING_TO_PARTITIONED_TABLE_WITH_NON_EMPTY_CLUSTERING_COLUMNS

DELTA_COLUMN_NOT_FOUND

Unable to find the column <columnName> given [<columnList>].

DELTA_COLUMN_NOT_FOUND_IN_MERGE

Unable to find the column '<targetCol>' of the target table from the INSERT columns: <colNames>. INSERT clause must specify value for all the columns of the target table.

DELTA_COLUMN_NOT_FOUND_IN_SCHEMA

Couldn't find column <columnName> in:

<tableSchema>

DELTA_COLUMN_PATH_NOT_NESTED

Expected <columnPath> to be a nested data type, but found <other>. Was looking for the

index of <column> in a nested field.

Schema:

<schema>

DELTA_COLUMN_STRUCT_TYPE_MISMATCH

SQLSTATE: 2200G

Struct column <source> cannot be inserted into a <targetType> field <targetField> in <targetTable>.

DELTA_COMMIT_INTERMEDIATE_REDIRECT_STATE

Cannot handle commit of table within redirect table state '<state>'.

DELTA_COMPACTION_VALIDATION_FAILED

The validation of the compaction of path <compactedPath> to <newPath> failed: Please file a bug report.

DELTA_COMPLEX_TYPE_COLUMN_CONTAINS_NULL_TYPE

SQLSTATE: 22005

Found nested VOID field in column <columName> which is of <dataType>. Delta doesn't support writing VOID in complex types.

DELTA_CONCURRENT_APPEND

Transaction conflict detected. A concurrent <operation> added data to table <tableName> committed at version <version>.

For more details see DELTA_CONCURRENT_APPEND

DELTA_CONCURRENT_DELETE_DELETE

Transaction conflict detected, a concurrent <operation> deleted data from table <tableName> (committed at version <version>) that this transaction attempted to delete.

For more details see DELTA_CONCURRENT_DELETE_DELETE

DELTA_CONCURRENT_DELETE_READ

Transaction conflict detected, a concurrent <operation> deleted data from table <tableName> (committed at version <version>) that this transaction read.

For more details see DELTA_CONCURRENT_DELETE_READ

DELTA_CONCURRENT_IDENTITY_COLUMN_DISABLED

Cannot <operation> table <tableId>: concurrent identity columns are disabled.

DELTA_CONCURRENT_IDENTITY_COLUMN_TOO_MANY_COLUMNS

SQLSTATE: 54011

Table <tableId> would have <numColumns> concurrent identity columns, which exceeds the maximum of <maxColumns>. Reduce the number of identity columns.

DELTA_CONCURRENT_TRANSACTION

ConcurrentTransactionException: This error occurs when multiple streaming queries are using the same checkpoint to write into this table. Did you run multiple instances of the same streaming query at the same time?<conflictingCommit>

Refer to <docLink> for more details.

DELTA_CONCURRENT_WRITE

ConcurrentWriteException: A concurrent transaction has written new data since the current transaction read the table. Please try the operation again.<conflictingCommit>

Refer to <docLink> for more details.

DELTA_CONFLICT_SET_COLUMN

There is a conflict from these SET columns: <columnList>.

DELTA_CONF_OVERRIDE_NOT_SUPPORTED_IN_COMMAND

During <command>, configuration "<configuration>" cannot be set from the command. Please remove it from the TBLPROPERTIES clause and then retry the command again.

DELTA_CONF_OVERRIDE_NOT_SUPPORTED_IN_SESSION

During <command>, configuration "<configuration>" cannot be set from the SparkSession configurations. Please unset it by running spark.conf.unset("<configuration>") and then retry the command again.

DELTA_CONSTRAINT_ALREADY_EXISTS

Constraint '<constraintName>' already exists. Please delete the old constraint first.

Old constraint:

<oldConstraint>

DELTA_CONSTRAINT_DATA_TYPE_MISMATCH

Column <columnName> has data type <columnType> and cannot be altered to data type <dataType> because this column is referenced by the following check constraint(s):

<constraints>

DELTA_CONSTRAINT_DEPENDENT_COLUMN_CHANGE

<tableProperties>

Delta configuration:

<configuration>

If you would like to merge the configurations (update existing fields and insert new ones), set the SQL configuration <metadataCheckSqlConf> to false.

DELTA_CONVERT_NON_PARQUET_TABLE

CONVERT TO DELTA only supports parquet tables, but you are trying to convert a <sourceName> source: <tableId>.

DELTA_CONVERT_TO_DELTA_ROW_TRACKING_WITHOUT_STATS

Cannot enable row tracking without collecting statistics.

If you want to enable row tracking, do the following:

Enable statistics collection by running the command

SET <statisticsCollectionPropertyKey> = true

Run CONVERT TO DELTA without the NO STATISTICS option.

If you do not want to collect statistics, disable row tracking:

Deactivate enabling the table feature by default by running the command:

RESET <rowTrackingTableFeatureDefaultKey>

Deactivate the table property by default by running:

SET <rowTrackingDefaultPropertyKey> = false

DELTA_COPY_INTO_TARGET_FORMAT

COPY INTO target must be a Delta table.

DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_SCHEMA

You are trying to create an external table <tableName>

from <path> using Delta, but the schema is not specified when the

input path is empty.

To learn more about Delta, see <docLink>

DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_TXN_LOG

You are trying to create an external table <tableName> from <path> using Delta, but there is no transaction log present at <logPath>. Check the upstream job to make sure that it is writing using format("delta") and that the path is the root of the table.

To learn more about Delta, see <docLink>

DELTA_CREATE_TABLE_IDENTIFIER_LOCATION_MISMATCH

Creating path-based Delta table with a different location isn't supported. Identifier: <identifier>, Location: <location>.

DELTA_CREATE_TABLE_MISSING_TABLE_NAME_OR_LOCATION

Table name or location has to be specified.

DELTA_CREATE_TABLE_SCHEME_MISMATCH

The specified schema does not match the existing schema at <path>.

== Specified ==

<specifiedSchema>

== Existing ==

<existingSchema>

== Differences ==

<schemaDifferences>

If your intention is to keep the existing schema, you can omit the

schema from the create table command. Otherwise please ensure that

the schema matches.

DELTA_CREATE_TABLE_SET_CLUSTERING_TABLE_FEATURE_NOT_ALLOWED

Cannot enable <tableFeature> table feature using TBLPROPERTIES. Please use CREATE OR REPLACE TABLE CLUSTER BY to create a Delta table with clustering.

DELTA_CREATE_TABLE_WITH_DIFFERENT_CLUSTERING

The specified clustering columns do not match the existing clustering columns at <path>.

== Specified ==

<specifiedColumns>

== Existing ==

<existingColumns>

DELTA_CREATE_TABLE_WITH_DIFFERENT_PARTITIONING

The specified partitioning does not match the existing partitioning at <path>.

== Specified ==

<specifiedColumns>

== Existing ==

<existingColumns>

DELTA_CREATE_TABLE_WITH_DIFFERENT_PROPERTY

The specified properties do not match the existing properties at <path>.

== Specified ==

<specifiedProperties>

== Existing ==

<existingProperties>

DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION

Cannot create table ('<tableId>'). The associated location ('<tableLocation>') is not empty and also not a Delta table.

DELTA_DATA_CHANGE_FALSE

Cannot change table metadata because the 'dataChange' option is set to false. Attempted operation: '<op>'.

DELTA_DEEP_CLONE_MV_ST_ERROR

Deep clone of a streaming table or materialized view failed:

For more details see DELTA_DEEP_CLONE_MV_ST_ERROR

DELTA_DEEP_CLONE_MV_ST_MISSING_PIPELINE_UUID

Source table <sourceTable> has no pipeline UUID. Deep clone requires a source with an associated pipeline.

DELTA_DEEP_CLONE_MV_ST_TARGET_ALREADY_EXISTS_AS_DELTA

Target table <targetTable> already exists as a regular Delta table. Drop the existing table first or choose a different target name.

DELTA_DELETED_PARQUET_FILE_NOT_FOUND

File <filePath> referenced in the transaction log cannot be found. This parquet file may be deleted under Delta's data retention policy.

Default Delta data retention duration: <logRetentionPeriod>. Modification time of the parquet file: <modificationTime>. Deletion time of the parquet file: <deletionTime>. Deleted on Delta version: <deletionVersion>.

DELTA_DELETION_VECTOR_MISSING_NUM_RECORDS

It is invalid to commit files with deletion vectors that are missing the numRecords statistic.

DELTA_DFV2_CREATE_REPLACE_INCOMPATIBLE_REPLACE_ON_OR_USING

DataFrame Writer V2 create()/replace()/createOrReplace() cannot be used with the replaceOn or replaceUsing option for Delta tables.

DELTA_DISABLE_SOURCE_MATERIALIZATION_IN_INSERT_REPLACE_ON_OR_USING_NOT_ALLOWED

Disabling source materialization in INSERT REPLACE ON/USING by setting 'spark.databricks.delta.insertReplaceOnOrUsing.materializeSource' to 'none' is not allowed.

DELTA_DISABLE_SOURCE_MATERIALIZATION_IN_MERGE_NOT_ALLOWED

Disabling source materialization in MERGE by setting 'spark.databricks.delta.merge.materializeSource' to 'none' is not allowed.

DELTA_DOMAIN_METADATA_NOT_SUPPORTED

Detected DomainMetadata action(s) for domains <domainNames>, but DomainMetadataTableFeature is not enabled.

DELTA_DROP_COLUMN_AT_INDEX_LESS_THAN_ZERO

SQLSTATE: 42KD8

Index <columnIndex> to drop column is lower than 0.

DELTA_DROP_COLUMN_ON_SINGLE_FIELD_SCHEMA

Cannot drop column from a schema with a single column. Schema:

<schema>

DELTA_DUPLICATE_ACTIONS_FOUND

File operation '<actionType>' for path <path> was specified several times.

It conflicts with <conflictingPath>.

It is not valid for multiple file operations with the same path to exist in a single commit.

DELTA_DUPLICATE_COLUMNS_FOUND

Found duplicate column(s): <duplicateCols>.

For more details see DELTA_DUPLICATE_COLUMNS_FOUND

DELTA_DUPLICATE_COLUMNS_ON_INSERT

Duplicate column names in INSERT clause.

DELTA_DUPLICATE_COLUMNS_ON_UPDATE_TABLE

<message>

Please remove duplicate columns before you update your table.

DELTA_DUPLICATE_DATA_SKIPPING_COLUMNS

Duplicated data skipping columns found: <columns>.

DELTA_DUPLICATE_DOMAIN_METADATA_INTERNAL_ERROR

Internal error: two DomainMetadata actions within the same transaction have the same domain <domainName>.

DELTA_DUPLICATE_LOG_ENTRIES_FOUND

The Delta log is in an illegal state: <numDuplicates> paths have duplicate entries in version <version>. RESTORE to a version before the commit that introduced the duplication or contact support for assistance.

DELTA_DV_HISTOGRAM_DESERIALIZATON

Could not deserialize the deleted record counts histogram during table integrity verification.

DELTA_DYNAMIC_PARTITION_OVERWRITE_DISABLED

Dynamic partition overwrite mode is specified by session config or write options, but it is disabled by spark.databricks.delta.dynamicPartitionOverwrite.enabled=false.

DELTA_DYNAMIC_PARTITION_OVERWRITE_INCOMPATIBLE_REPLACE_ON_OR_USING

Dynamic partition overwrite is incompatible with the replaceOn/replaceUsing option.

DELTA_EMPTY_DATA

Data used in creating the Delta table doesn't have any columns.

DELTA_EMPTY_DIRECTORY

No file found in the directory: <directory>.

DELTA_ERROR_FINDING_COLUMN_POSITION

Error while searching for the position of the column <column>.

Schema:

<schema>

Error:

<message>

DELTA_EXCEED_CHAR_VARCHAR_LIMIT

SQLSTATE: 22001

Value "<value>" exceeds char/varchar type length limitation. Failed check: <expr>.

DELTA_FAILED_CAST_PARTITION_VALUE

Failed to cast partition value <value> to <dataType>.

DELTA_FAILED_FIND_ATTRIBUTE_IN_OUTPUT_COLUMNS

Could not find <newAttributeName> among the existing target output <targetOutputColumns>.

DELTA_FAILED_INFER_SCHEMA

Failed to infer schema from the given list of files.

DELTA_FAILED_MERGE_SCHEMA_FILE

SQLSTATE: 42KDA

Failed to merge schema of file <file>:

<schema>

DELTA_FAILED_OPERATION_ON_SHALLOW_CLONE

Failed to run the operation on the source table <sourceTable> because the shallow clone <targetTable> still exists and the following error occurred in the shallow clone: <message>

DELTA_FAILED_READ_FILE_FOOTER

SQLSTATE: KD001

Could not read footer for file: <currentFile>.

DELTA_FAILED_RECOGNIZE_PREDICATE

Cannot recognize the predicate '<predicate>'.

DELTA_FAILED_SCAN_WITH_HISTORICAL_VERSION

Expect a full scan of the latest version of the Delta source, but found a historical scan of version <historicalVersion>.

DELTA_FAILED_TO_MERGE_FIELDS

SQLSTATE: 22005

Failed to merge fields '<currentField>' and '<updateField>'.

DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: <features>.

DELTA_FEATURES_REQUIRE_MANUAL_ENABLEMENT

Your table schema requires manually enablement of the following table feature(s): <unsupportedFeatures>.

To do this, run the following command for each of features listed above:

ALTER TABLE table_name SET TBLPROPERTIES ('delta.feature.feature_name' = 'supported')

Replace "table_name" and "feature_name" with real values.

Current supported feature(s): <supportedFeatures>.

DELTA_FEATURE_CAN_ONLY_DROP_CHECKPOINT_PROTECTION_WITH_HISTORY_TRUNCATION

Could not drop the Checkpoint Protection feature.

This feature can only be dropped by truncating history.

Please try again with the TRUNCATE HISTORY option:

ALTER TABLE table_name DROP FEATURE checkpointProtection TRUNCATE HISTORY

DELTA_FEATURE_DROP_AFE_MARKER_ABSENT

Cannot drop <feature> on an Auto Feature Enablement (AFE) cluster because its internal AFE provenance marker is not set.

DELTA_FEATURE_DROP_AFE_MARKER_MISMATCH

Cannot drop <feature> on an Auto Feature Enablement (AFE) cluster because its value no longer matches its AFE provenance marker.

DELTA_FEATURE_DROP_CHECKPOINT_FAILED

Dropping <featureName> failed due to a failure in checkpoint creation.

Please try again later. It the issue persists, contact Databricks support.

DELTA_FEATURE_DROP_CHECKPOINT_PROTECTION_WAIT_FOR_RETENTION_PERIOD

The operation did not succeed because there are still traces of dropped features

in the table history. CheckpointProtection cannot be dropped until these historical

versions have expired.

To drop CheckpointProtection, please wait for the historical versions to

expire, and then repeat this command. The retention period for historical versions is

currently configured to <truncateHistoryLogRetentionPeriod>.

DELTA_FEATURE_DROP_CONFLICT_REVALIDATION_FAIL

Cannot drop feature because a concurrent transaction modified the table.

Please try the operation again.

<concurrentCommit>

DELTA_FEATURE_DROP_DEPENDENT_FEATURE

Cannot drop table feature <feature> because some other features (<dependentFeatures>) in this table depends on <feature>.

Consider dropping them first before dropping this feature.

DELTA_FEATURE_DROP_FEATURE_IS_DELTA_PROPERTY

Cannot drop <property> from this table because this is a delta table property and not a table feature.

DELTA_FEATURE_DROP_FEATURE_NOT_PRESENT

Cannot drop <feature> from this table because it is not currently present in the table's protocol.

DELTA_FEATURE_DROP_HISTORICAL_VERSIONS_EXIST

Cannot drop <feature> because the Delta log contains historical versions that use the feature.

Please wait until the history retention period (<logRetentionPeriodKey>=<logRetentionPeriod>)

has passed since the feature was last active.

Alternatively, please wait for the TRUNCATE HISTORY retention period to expire (<truncateHistoryLogRetentionPeriod>)

and then run:

ALTER TABLE table_name DROP FEATURE feature_name TRUNCATE HISTORY

DELTA_FEATURE_DROP_HISTORY_TRUNCATION_NOT_ALLOWED

The particular feature does not require history truncation.

DELTA_FEATURE_DROP_NONREMOVABLE_FEATURE

Cannot drop <feature> because dropping this feature is not supported.

Please contact Databricks support.

DELTA_FEATURE_DROP_TRUNCATE_HISTORY_METADATA_CLEANUP_DISABLED

Cannot drop <feature> with TRUNCATE HISTORY: Delta metadata cleanup is currently disabled. Contact Databricks support.

DELTA_FEATURE_DROP_UNSUPPORTED_CLIENT_FEATURE

Cannot drop <feature> because it is not supported by this Databricks version.

Consider using Databricks with a higher version.

DELTA_FEATURE_DROP_WAIT_FOR_RETENTION_PERIOD

Dropping <feature> was partially successful.

The feature is now no longer used in the current version of the table. However, the feature

is still present in historical versions of the table. The table feature cannot be dropped

from the table protocol until these historical versions have expired.

To drop the table feature from the protocol, please wait for the historical versions to

expire, and then repeat this command. The retention period for historical versions is

currently configured as <logRetentionPeriodKey>=<logRetentionPeriod>.

Alternatively, please wait for the TRUNCATE HISTORY retention period to expire (<truncateHistoryLogRetentionPeriod>)

and then run:

ALTER TABLE table_name DROP FEATURE feature_name TRUNCATE HISTORY

DELTA_FEATURE_REQUIRES_HIGHER_READER_VERSION

Unable to enable table feature <feature> because it requires a higher reader protocol version (current <current>). Consider upgrading the table's reader protocol version to <required>, or to a version which supports reader table features. Refer to <docLink> for more information on table protocol versions.

DELTA_FEATURE_REQUIRES_HIGHER_WRITER_VERSION

Unable to enable table feature <feature> because it requires a higher writer protocol version (current <current>). Consider upgrading the table's writer protocol version to <required>, or to a version which supports writer table features. Refer to <docLink> for more information on table protocol versions.

DELTA_FILE_ALREADY_EXISTS

Existing file path <path>.

DELTA_FILE_LISTING_MAX_RESULT_SIZE_EXCEEDED

SQLSTATE: 82100

The Delta table at <tablePath> has too many files to list within the current spark.driver.maxResultSize limit (currently <currentMaxResultSize>).

Increase spark.driver.maxResultSize to accommodate larger file listings, but be cautious: setting it too high relative to driver memory can cause driver instability. Consider using a larger driver node type if needed.

DELTA_FILE_LIST_AND_PATTERN_STRING_CONFLICT

Cannot specify both file list and pattern string.

DELTA_FILE_NOT_FOUND

File path <path>.

DELTA_FILE_NOT_FOUND_DETAILED

File <filePath> referenced in the transaction log cannot be found. This occurs when data has been manually deleted from the file system rather than using the table DELETE statement.

It can also be caused by a VACUUM operation that cleaned up data not yet processed if the table's retention period is too short.

Restart your query with a new checkpoint location, or use spark.sql.files.ignoreMissingFiles to skip the missing files. For more information, see <faqPath>

DELTA_FILE_OR_DIR_NOT_FOUND

No such file or directory: <path>.

DELTA_FILE_TO_OVERWRITE_NOT_FOUND

File (<path>) to be rewritten not found among candidate files:

<pathList>

DELTA_FOUND_MAP_TYPE_COLUMN

A MapType was found. In order to access the key or value of a MapType, specify one

of:

<key> or

<value>

followed by the name of the column (only if that column is a struct type).

for example, mymap.key.mykey

If the column is a basic type, mymap.key or mymap.value is sufficient.

DELTA_GENERATED_COLUMNS_DEPENDENT_COLUMN_CHANGE

Cannot alter column <columnName> because this column is referenced by the following generated column(s):

<generatedColumns>.

DELTA_GENERATED_COLUMNS_EXPR_TYPE_MISMATCH

The expression type of the generated column <columnName> is <expressionType>, but the column type is <columnType>.

DELTA_GENERATED_COLUMN_UPDATE_TYPE_MISMATCH

Column <currentName> is a generated column or a column used by a generated column. The data type is <currentDataType> and cannot be converted to data type <updateDataType>.

DELTA_GEOSPATIAL_NOT_SUPPORTED

Geospatial types are not supported in this version of Delta Lake.

DELTA_GEOSPATIAL_SRID_NOT_SUPPORTED

Geospatial type has an unsupported srid: <srid>. Delta tables only support non-negative srid values.

DELTA_HIERARCHICAL_CLUSTERING_COLUMNS_NOT_CLUSTERING_COLUMNS

The 'delta.liquid.hierarchicalClusteringColumns' property [<hierarchicalColumns>] contains columns that are not clustering columns. The current clustering columns are [<clusteringColumns>]. All columns in hierarchicalClusteringColumns must be a subset of the clustering columns.

DELTA_ICEBERG_COMPAT_VIOLATION

The validation of IcebergCompatV<version> has failed.

For more details see DELTA_ICEBERG_COMPAT_VIOLATION

DELTA_ICEBERG_WRITER_COMPAT_VIOLATION

The validation of IcebergWriterCompatV<version> has failed.

For more details see DELTA_ICEBERG_WRITER_COMPAT_VIOLATION

DELTA_IDENTITY_COLUMNS_ALTER_COLUMN_NOT_SUPPORTED

ALTER TABLE ALTER COLUMN is not supported for IDENTITY columns.

DELTA_IDENTITY_COLUMNS_ALTER_NON_DELTA_FORMAT

ALTER TABLE ALTER COLUMN SYNC IDENTITY is only supported by Delta.

DELTA_IDENTITY_COLUMNS_ALTER_NON_IDENTITY_COLUMN

ALTER TABLE ALTER COLUMN SYNC IDENTITY cannot be called on non IDENTITY columns.

DELTA_IDENTITY_COLUMNS_EXPLICIT_INSERT_NOT_SUPPORTED

SQLSTATE: 42808

Providing values for GENERATED ALWAYS AS IDENTITY column <colName> is not supported.

DELTA_IDENTITY_COLUMNS_ILLEGAL_STEP

SQLSTATE: 42611

IDENTITY column step cannot be 0.

DELTA_IDENTITY_COLUMNS_NON_DELTA_FORMAT

IDENTITY columns are only supported by Delta.

DELTA_IDENTITY_COLUMNS_PARTITION_NOT_SUPPORTED

PARTITIONED BY IDENTITY column <colName> is not supported.

DELTA_IDENTITY_COLUMNS_REPLACE_COLUMN_NOT_SUPPORTED

ALTER TABLE REPLACE COLUMNS is not supported for table with IDENTITY columns.

DELTA_IDENTITY_COLUMNS_UNSUPPORTED_DATA_TYPE

SQLSTATE: 428H2

DataType <dataType> is not supported for IDENTITY columns.

DELTA_IDENTITY_COLUMNS_UPDATE_NOT_SUPPORTED

SQLSTATE: 42808

UPDATE on IDENTITY column <colName> is not supported.

DELTA_IDENTITY_COLUMNS_WITH_GENERATED_EXPRESSION

IDENTITY column cannot be specified with a generated column expression.

DELTA_IDENTITY_COLUMN_INCONSISTENT_METADATA

Inconsistent IDENTITY metadata for column <colName> detected: <hasStart>, <hasStep>, <hasInsert>

DELTA_ILLEGAL_OPTION

Invalid value '<input>' for option '<name>', <explain>

DELTA_ILLEGAL_USAGE

The usage of <option> is not allowed when <operation> a Delta table.

DELTA_INCOMPATIBLE_DATAFRAME_OPTIONS

The <firstDeltaOption> option cannot be used with the <secondDeltaOption> option for Delta tables.

DELTA_INCONSISTENT_BUCKET_SPEC

BucketSpec on Delta bucketed table does not match BucketSpec from metadata. Expected: <expected>. Actual: <actual>.

DELTA_INCONSISTENT_LOGSTORE_CONFS

(<setKeys>) cannot be set to different values. Please only set one of them, or set them to the same value.

DELTA_INCORRECT_ARRAY_ACCESS

Incorrectly accessing an ArrayType. Use arrayname.element.elementname position to

add to an array.

DELTA_INCORRECT_ARRAY_ACCESS_BY_NAME

An ArrayType was found. In order to access elements of an ArrayType, specify

<rightName> instead of <wrongName>.

Schema:

<schema>

DELTA_INCORRECT_GET_CONF

Use getConf() instead of conf.getConf().

DELTA_INCORRECT_LOG_STORE_IMPLEMENTATION

SQLSTATE: 2200P

Interval cannot be null or blank.

DELTA_INVALID_CDC_RANGE

CDC range from start <start> to end <end> was invalid. End cannot be before start.

DELTA_INVALID_CHARACTERS_IN_COLUMN_NAME

Attribute name "<columnName>" contains invalid character(s) among " ,;{}()\n\t=". Please use alias to rename it.

DELTA_INVALID_CHARACTERS_IN_COLUMN_NAMES

Found invalid character(s) among ' ,;{}()\n\t=' in the column names of your schema.

Invalid column names: <invalidColumnNames>.

Please use other characters and try again.

Alternatively, enable Column Mapping to keep using these characters.

DELTA_INVALID_CHECK_CONSTRAINT_REFERENCES

Found <colName> in CHECK constraint. A check constraint cannot use a non-existent column.

DELTA_INVALID_CLONE_PATH

The target location for CLONE needs to be an absolute path or table name. Use an

absolute path instead of <path>.

DELTA_INVALID_COLUMN_NAMES_WHEN_REMOVING_COLUMN_MAPPING

Found invalid character(s) among ' ,;{}()\n\t=' in the column names of your schema.

Invalid column names: <invalidColumnNames>.

Column mapping cannot be removed when there are invalid characters in the column names.

Please rename the columns to remove the invalid characters and execute this command again.

DELTA_INVALID_CONSTRAINT_NAME

Cannot use <name> as the name of a CHECK constraint. This name is reserved.

DELTA_INVALID_FORMAT

Incompatible format detected.

A transaction log for Delta was found at <deltaRootPath>/_delta_log,

but you are trying to <operation> <path> using format("<format>"). You must use

'format("delta")' when reading and writing to a delta table.

To learn more about Delta, see <docLink>

DELTA_INVALID_GENERATED_COLUMN_REFERENCES

A generated column cannot use a non-existent column or another generated column.

DELTA_INVALID_IDEMPOTENT_WRITES_OPTIONS

Invalid options for idempotent Dataframe writes: <reason>

DELTA_INVALID_INDEX_AUTO_VALUE

Invalid value '<value>' for table property 'index.auto', must be 'true' or 'false'.

DELTA_INVALID_INTERVAL

<interval> is not a valid INTERVAL.

DELTA_INVALID_INVENTORY_SCHEMA

The schema for the specified INVENTORY does not contain all of the required fields. Required fields are: <expectedSchema>

DELTA_INVALID_ISOLATION_LEVEL

invalid isolation level '<isolationLevel>'.

DELTA_INVALID_LOGSTORE_CONF

(<classConfig>) and (<schemeConfig>) cannot be set at the same time. Please set only one group of them.

DELTA_INVALID_MANAGED_TABLE_SYNTAX_NO_SCHEMA

The provided timestamp <timestamp> does not match the expected syntax <format>.

DELTA_LIQUID_SORT_WITHIN_FILES_COLUMNS_NOT_IN_SCHEMA

The 'delta.liquid.sortWithinFilesColumns' property contains columns <missingColumns> that do not exist in the table schema:

<tableSchema>

DELTA_LOG_ALREADY_EXISTS

A Delta log already exists at <path>.

DELTA_LOG_FILE_NOT_FOUND

Unable to retrieve the delta log files to construct table version <version> starting from checkpoint version <checkpointVersion> at <logPath>.

DELTA_LOG_FILE_NOT_FOUND_FOR_STREAMING_SOURCE

If you never deleted it, it's likely your query is lagging behind. Please delete its checkpoint to restart from scratch. To avoid this happening again, you can update your retention policy of your Delta table.

DELTA_LOG_JSON_FILE_ACCESS_DENIED

Access denied when reading Delta log JSON file: <filePath>. Check that you have read permissions for the Delta table location.

DELTA_MATERIALIZED_ROW_TRACKING_COLUMN_NAME_MISSING

Materialized <rowTrackingColumn> column name missing for <tableName>.

DELTA_MATERIALIZE_VOID_TYPE_NOT_SUPPORTED

Enabling the materializeVoidType-preview table feature is not supported.

DELTA_MAX_ARRAY_SIZE_EXCEEDED

Please use a limit less than Int.MaxValue - 8.

DELTA_MAX_COMMIT_RETRIES_EXCEEDED

This commit has failed as it has been tried <numAttempts> times but did not succeed.

This can be caused by the Delta table being committed continuously by many concurrent

commits.

Commit started at version: <startVersion>

Commit failed at version: <failVersion>

Number of actions attempted to commit: <numActions>

Total time spent attempting this commit: <timeSpent> ms

DELTA_MAX_LIST_FILE_EXCEEDED

File list must have at most <maxFileListSize> entries, had <numFiles>.

DELTA_MAX_MST_COMMIT_RETRIES_EXCEEDED

The table <tableName> already exists in the catalog but no metadata could be found for the table at the path <tablePath>.

Did you manually delete files from the _delta_log directory? If so, then you should be able to recreate it as follows. First, drop the table by running DROP TABLE <tableNameForDropCmd>. Then, recreate it by running the current command again.

DELTA_METADATA_CHANGED

MetadataChangedException: The metadata of the Delta table <tableName> has been changed by a concurrent update. Please try the operation again.<conflictingCommit>

Refer to <docLink> for more details.

DELTA_METADATA_CLEANUP_DISABLED

Table metadata cleanup is disabled for this workspace.

DELTA_METADATA_MISMATCH

SQLSTATE: 42KDG

A metadata mismatch was detected when writing to the Delta table.

For more details see DELTA_METADATA_MISMATCH

DELTA_MISSING_CHANGE_DATA

Error getting change data for range [<startVersion> , <endVersion>] as change data was not

recorded for version [<version>]. If you've enabled change data feed on this table,

use DESCRIBE HISTORY to see when it was first enabled.

Otherwise, to start recording change data, use ALTER TABLE table_name SET TBLPROPERTIES

(<key>=true).

DELTA_MISSING_COLUMN

Cannot find <columnName> in table columns: <columnList>.

DELTA_MISSING_COMMIT_INFO

This table has the feature <featureName> enabled which requires the presence of the CommitInfo action in every commit. However, the CommitInfo action is missing from commit version <version>.

DELTA_MISSING_COMMIT_TIMESTAMP

This table has the feature <featureName> enabled which requires the presence of commitTimestamp in the CommitInfo action. However, this field has not been set in commit version <version>.

DELTA_MISSING_DELTA_TABLE

<tableName> is not a Delta table.

DELTA_MISSING_DELTA_TABLE_COPY_INTO

Table doesn't exist. Create an empty Delta table first using CREATE TABLE <tableName>.

DELTA_MISSING_FILES_UNEXPECTED_VERSION

Delta stream cannot resume from version <startVersion>; transaction log starts at <earliestVersion>. Log files may have been deleted by log retention. Restart the stream with a new checkpoint location and consider increasing delta.logRetentionDuration. To skip missing data instead, set .option("<option>", "false").

DELTA_MISSING_ICEBERG_CLASS

Apache Iceberg class was not found. Please ensure Delta Apache Iceberg support is installed.

Please refer to <docLink> for more details.

DELTA_MISSING_NOT_NULL_COLUMN_VALUE

SQLSTATE: 23502

Column <columnName>, which has a NOT NULL constraint, is missing from the data being written into the table.

DELTA_MISSING_PARTITION_COLUMN

SQLSTATE: 42KD6

Partition column <columnName> not found in schema <columnList>.

DELTA_MISSING_PART_FILES

SQLSTATE: 42KD6

Couldn't find all part files of the checkpoint version: <version>.

DELTA_MISSING_PROVIDER_FOR_CONVERT

CONVERT TO DELTA only supports parquet tables. Please rewrite your target as parquet.<path> if it's a parquet directory.

DELTA_MISSING_ROW_TRACKING_FOR_CDC

Error getting change data for <tableName> as row tracking was not enabled. To enable row tracking, use ALTER TABLE table_name SET TBLPROPERTIES (<key>=true).

DELTA_MISSING_SET_COLUMN

SET column <columnName> not found given columns: <columnList>.

DELTA_MISSING_TRANSACTION_LOG

Incompatible format detected.

You are trying to <operation> <path> using Delta, but there is no

transaction log present. Check the upstream job to make sure that it is writing

using format("delta") and that you are trying to %1$s the table base path.

To learn more about Delta, see <docLink>

DELTA_MODE_NOT_SUPPORTED

Specified mode '<mode>' is not supported. Supported modes are: <supportedModes>.

DELTA_MULTIPLE_CDC_BOUNDARY

Multiple <startingOrEnding> arguments provided for CDC read. Please provide one of either <startingOrEnding>Timestamp or <startingOrEnding>Version.

DELTA_MULTIPLE_CONF_FOR_SINGLE_COLUMN_IN_BLOOM_FILTER

Multiple bloom filter index configurations passed to command for column: <columnName>.

DELTA_MULTIPLE_SOURCE_ROW_MATCHING_TARGET_ROW_IN_MERGE

SQLSTATE: 21506

Cannot perform Merge as multiple source rows matched and attempted to modify the same

target row in the Delta table in possibly conflicting ways. By SQL semantics of Merge,

when multiple source rows match on the same target row, the result may be ambiguous

as it is unclear which source row should be used to update or delete the matching

target row. You can preprocess the source table to eliminate the possibility of

multiple matches. Please refer to

<usageReference>

DELTA_MUST_SET_ALL_COORDINATED_COMMITS_CONFS_IN_COMMAND

During <command>, either both coordinated commits configurations ("delta.coordinatedCommits.commitCoordinator-preview", "delta.coordinatedCommits.commitCoordinatorConf-preview") are set in the command or neither of them. Missing: "<configuration>". Please specify this configuration in the TBLPROPERTIES clause or remove the other configuration, and then retry the command again.

DELTA_MUST_SET_ALL_COORDINATED_COMMITS_CONFS_IN_SESSION

During <command>, either both coordinated commits configurations ("coordinatedCommits.commitCoordinator-preview", "coordinatedCommits.commitCoordinatorConf-preview") are set in the SparkSession configurations or neither of them. Missing: "<configuration>". Please set this configuration in the SparkSession or unset the other configuration, and then retry the command again.

DELTA_NAME_CONFLICT_IN_BUCKETED_TABLE

The following column name(s) are reserved for Delta bucketed table internal usage only: <names>.

DELTA_NESTED_CORRELATED_SUBQUERY_NOT_SUPPORTED

Nested correlated subquery is not supported in the <operation> condition.

DELTA_NESTED_FIELDS_NEED_RENAME

The input schema contains nested fields that are capitalized differently than the target table.

They need to be renamed to avoid the loss of data in these fields while writing to Delta.

Fields:

<fields>.

Original schema:

<schema>

DELTA_NESTED_NOT_NULL_CONSTRAINT

Delta log commit versions are out of order: <previousVersion> does not precede <nextVersion>. The log may be corrupt. Contact Databricks support.

DELTA_NON_PARSABLE_TAG

Could not parse tag <tag>.

File tags are: <tagList>.

DELTA_NON_PARTITION_COLUMN_ABSENT

SQLSTATE: KD005

Data written into Delta needs to contain at least one non-partitioned column.<details>

DELTA_NON_PARTITION_COLUMN_REFERENCE

Predicate references non-partition column '<columnName>'. Only the partition columns may be referenced: [<columnList>].

DELTA_NON_PARTITION_COLUMN_SPECIFIED

Non-partitioning column(s) <columnList> are specified where only partitioning columns are expected: <fragment>.

DELTA_NON_SINGLE_PART_NAMESPACE_FOR_CATALOG

Delta catalog requires a single-part namespace, but <identifier> is multi-part.

DELTA_NON_UC_COMMIT_COORDINATOR_NOT_SUPPORTED_IN_COMMAND

Setting commit coordinator to '<nonUcCoordinatorName>' from command is not supported, because UC-managed tables can only have 'unity-catalog' as the commit coordinator. Please either change it to 'unity-catalog' or remove all Coordinated Commits table properties from the TBLPROPERTIES clause, and then retry the command again.

DELTA_NON_UC_COMMIT_COORDINATOR_NOT_SUPPORTED_IN_SESSION

Setting commit coordinator to '<nonUcCoordinatorName>' from SparkSession configurations is not supported, because UC-managed tables can only have 'unity-catalog' as the commit coordinator. Please either change it to 'unity-catalog' by running spark.conf.set("<coordinatorNameDefaultKey>", "unity-catalog"), or remove all Coordinated Commits table properties from the SparkSession configurations by running spark.conf.unset("<coordinatorNameDefaultKey>"), spark.conf.unset("<coordinatorConfDefaultKey>"), spark.conf.unset("<tableConfDefaultKey>"), and then retry the command again.

DELTA_NON_UC_MANAGED_TABLE_UPGRADE_OR_DOWNGRADE_NOT_SUPPORTED

Table <tableName> is not UC-managed. Only UC-managed tables can be upgraded or downgraded to catalog-managed tables.

DELTA_NOT_A_DATABRICKS_DELTA_TABLE

<table> is not a Delta table. Please drop this table first if you would like to create it with Databricks Delta.

DELTA_NOT_A_DELTA_TABLE

<tableName> is not a Delta table. Please drop this table first if you would like to recreate it with Delta Lake.

DELTA_NOT_NULL_COLUMN_NOT_FOUND_IN_STRUCT

Not nullable column not found in struct: <struct>.

DELTA_NOT_NULL_CONSTRAINT_VIOLATED

SQLSTATE: 23502

NOT NULL constraint violated for column: <columnName>.

DELTA_NOT_NULL_NESTED_FIELD

A non-nullable nested field can't be added to a nullable parent. Please set the nullability of the parent column accordingly.

DELTA_NO_COMMITS_FOUND

No commits found at <logPath>.

DELTA_NO_RECREATABLE_HISTORY_FOUND

No recreatable commits found at <logPath>.

DELTA_NO_REDIRECT_RULES_VIOLATED

Operation not allowed: <operation> cannot be performed on a table with redirect feature.

Cannot write to already existent path <path> without setting OVERWRITE = 'true'.

DELTA_PATH_NOT_SPECIFIED

'path' is not specified.

DELTA_POST_COMMIT_HOOK_FAILED

SQLSTATE: 2DKD0

Committing to the Delta table version <version> succeeded but error while executing post-commit hook <name> <message>

DELTA_PROTOCOL_CHANGED

ProtocolChangedException: The protocol version of the Delta table has been changed by a concurrent update. <additionalInfo> <conflictingCommit>

Refer to <docLink> for more details.

DELTA_PROTOCOL_PROPERTY_NOT_INT

Protocol property <key> needs to be an integer. Found <value>.

DELTA_READ_FEATURE_PROTOCOL_REQUIRES_WRITE

Unable to upgrade only the reader protocol version to use table features. Writer protocol version must be at least <writerVersion> to proceed. Refer to <docLink> for more information on table protocol versions.

DELTA_READ_SOURCE_SCHEMA_CONFLICT

SQLSTATE: 42K07

The schema provided for the streaming source read doesn't match the schema of the Delta table.

Provided schema: <providedSchema>

Table schema: <tableSchema>

To fix this, either omit the schema option so the table schema is used automatically,

or ensure that the provided schema matches the Delta table schema exactly.

DELTA_READ_TABLE_WITHOUT_COLUMNS

You are trying to read a Delta table <tableName> that does not have any columns.

Write some new data with the option mergeSchema = true to be able to read the table.

DELTA_READ_TIME_CDC_NOT_SUPPORTED_FOR_TABLES_WITH_ACCESS_POLICIES

You are attempting to compute Change Data Feed on <tableName> that has access policies defined. Read Time Change Data Feed is currently in preview and does not support CDF on tables with access policies. Enable Read-optimized CDF by setting table property '<cdfTableProperty>' to 'true' on your table.

DELTA_REDIRECT_TARGET_ROW_FILTER_COLUMN_MASK_UNSUPPORTED

Redirect to a table with row filter or column mask is not supported. Update your code to reference the target table <tableIdent> directly.

DELTA_REDIRECT_VALIDATION_FAILED_EXTERNAL_URL_MISMATCH

Redirect validation failed: The target table <targetTableIdent> does not acknowledge the redirect from source path '<sourcePath>'. This may indicate a misconfigured or unauthorized redirect.

DELTA_REGEX_OPT_SYNTAX_ERROR

SQLSTATE: 2201B

Please recheck your syntax for '<regExpOption>'.

DELTA_RELATION_PATH_MISMATCH

SQLSTATE: 2201B

Relation path '<relation>' mismatches with <targetType>'s path '<targetPath>'.

Cannot assign row IDs without row count statistics.

Collect statistics for the table by running the ANALYZE TABLE command:

ANALYZE TABLE tableName COMPUTE DELTA STATISTICS

DELTA_ROW_TRACKING_BACKFILL_RUNNING_CONCURRENTLY_WITH_UNBACKFILL

A Row Tracking enablement operation was detected running concurrently with a Row Tracking disablement. Aborting the disablement operation. Please retry the disablement operation if necessary when the enablement operation is complete.

DELTA_ROW_TRACKING_ILLEGAL_PROPERTY_COMBINATION

Illegal table state was detected. Table properties <property1> and <property2> are both set to true. The issue can be resolved by disabling any of the two table properties.

Please contact Databricks support for further assistance.

DELTA_SCHEMA_CHANGED

Detected schema change:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory.

DELTA_SCHEMA_CHANGED_WITH_STARTING_OPTIONS

Detected schema change in version <version>:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory. If the issue persists after

changing to a new checkpoint directory, you may need to change the existing

'startingVersion' or 'startingTimestamp' option to start from a version newer than

<version> with a new checkpoint directory.

DELTA_SCHEMA_CHANGED_WITH_VERSION

Detected schema change in version <version>:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory.

DELTA_SCHEMA_CHANGE_SINCE_ANALYSIS

The schema of your Delta table has changed in an incompatible way since your DataFrame

or DeltaTable object was created. Please redefine your DataFrame or DeltaTable object.

Changes:

<schemaDiff> <legacyFlagMessage>

DELTA_SCHEMA_NOT_PROVIDED

SQLSTATE: 42908

Table schema is not provided. Please provide the schema (column definition) of the table when using REPLACE table and an AS SELECT query is not provided.

DELTA_SCHEMA_NOT_SET

SQLSTATE: KD008

Table schema is not set. Write data into it or use CREATE TABLE to set the schema.

DELTA_SET_LOCATION_SCHEMA_MISMATCH

The schema of the new Delta location is different than the current table schema.

original schema:

<original>

destination schema:

<destination>

If this is an intended change, you may turn this check off by running:

%%sql set <config> = true

DELTA_SHALLOW_CLONE_FILE_NOT_FOUND

File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This table appears to be a shallow clone, if that is the case, this error can occur when the original table from which this table was cloned has deleted a file that the clone is still using. If you want any clones to be independent of the original table, use a DEEP clone instead.

DELTA_SHARING_CANNOT_MODIFY_RESERVED_RECIPIENT_PROPERTY

Pre-defined properties that start with <prefix> cannot be modified.

DELTA_SHARING_CURRENT_RECIPIENT_PROPERTY_UNDEFINED

The data is restricted by recipient property <property> that do not apply to the current recipient in the session.

For more details see DELTA_SHARING_CURRENT_RECIPIENT_PROPERTY_UNDEFINED

DELTA_SHARING_INVALID_OP_IN_EXTERNAL_SHARED_VIEW

SQLSTATE: 42887

<operation> cannot be used in OpenSharing views that are shared cross account.

DELTA_SHARING_INVALID_PROVIDER_AUTH

Illegal authentication type <authenticationType> for provider <provider>.

DELTA_SHARING_INVALID_RECIPIENT_AUTH

Illegal authentication type <authenticationType> for recipient <recipient>.

DELTA_SHARING_INVALID_SHARED_DATA_OBJECT_NAME

Invalid name to reference a <type> inside a Share. You can either use <type>'s name inside the share following the format of [schema].[<type>], or you can also use table's original full name following the format of [catalog].[schema].[>type>].

If you are unsure about what name to use, you can run "SHOW ALL IN SHARE [share]" and find the name of the <type> to remove: column "name" is the <type>'s name inside the share and column "shared_object" is the <type>'s original full name.

DELTA_SHARING_MAXIMUM_RECIPIENT_TOKENS_EXCEEDED

There are more than two tokens for recipient <recipient>.

DELTA_SHARING_RECIPIENT_PROPERTY_NOT_FOUND

Recipient property <property> does not exist.

DELTA_SHARING_RECIPIENT_TOKENS_NOT_FOUND

Recipient tokens are missing for recipient <recipient>.

DELTA_SHARING_UNEXPECTED_HTTP_STATUS

The OpenSharing server returned an unexpected HTTP status. <message>

DELTA_SHARING_UNSUPPORTED_OPERATION

DELTA_STATS_NOT_FOUND_IN_FILE

Stats not found in file: <filePath>. Run 'ANALYZE TABLE [tableName] COMPUTE DELTA STATISTICS' to compute stats.

DELTA_STREAMING_CANNOT_CONTINUE_PROCESSING_POST_SCHEMA_EVOLUTION

We've detected one or more non-additive schema change(s) (<opType>) between Delta version <previousSchemaChangeVersion> and <currentSchemaChangeVersion> in the Delta streaming source.

Changes:

<columnChangeDetails>

Please check if you want to manually propagate the schema change(s) to the sink table before we proceed with stream processing using the finalized schema at version <currentSchemaChangeVersion>.

Once you have fixed the schema of the sink table or have decided there is no need to fix, you can set the following configuration(s) to unblock the non-additive schema change(s) and continue stream processing.

Using dataframe reader option(s):

To unblock for this particular stream just for this series of schema change(s):

<unblockChangeOptions>

To unblock for this particular stream:

<unblockStreamOptions>

Using SQL configuration(s):

To unblock for this particular stream just for this series of schema change(s):

<unblockChangeConfs>

To unblock for this particular stream:

<unblockStreamConfs>

To unblock for all streams:

<unblockAllConfs>

DELTA_STREAMING_CHECK_COLUMN_MAPPING_NO_SNAPSHOT

Failed to obtain Delta log snapshot for the start version when checking column mapping schema changes. Please choose a different start version, or force enable streaming read at your own risk by setting '<config>' to 'true'.

DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE

Streaming read is not supported on tables with read-incompatible schema changes (for example, rename or drop or datatype changes).

For further information and possible next steps to resolve this issue, please review the documentation at <docLink>

Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.

DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE_USE_SCHEMA_LOG

Streaming read is not supported on tables with read-incompatible schema changes (for example, rename or drop or datatype changes).

Please provide a 'schemaTrackingLocation' to enable non-additive schema evolution for Delta stream processing.

See <docLink> for more details.

Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.

DELTA_STREAMING_INTERRUPTED_BY_MANAGED_TABLE_CONVERSION

The table at <path> has been converted to a Unity Catalog managed table.

The schema, table configuration or protocol of your Delta table has changed during streaming.

The schema or metadata tracking log has been updated.

Please restart the stream to continue processing using the updated metadata.

Updated schema: <schema>.

Updated table configurations: <config>.

Updated table protocol: <protocol>

DELTA_STREAMING_SCHEMA_EVOLUTION_UNSUPPORTED_ROW_FILTER_COLUMN_MASKS

Streaming from source table <tableId> with schema tracking does not support row filters or column masks.

Please drop the row filters or column masks, or disable schema tracking.

DELTA_STREAMING_SCHEMA_LOCATION_CONFLICT

Detected conflicting schema location '<loc>' while streaming from table or table located at '<table>'.

Another stream may be reusing the same schema location, which is not allowed.

Please provide a new unique schemaTrackingLocation path or streamingSourceTrackingId as a reader option for one of the streams from this table.

DELTA_STREAMING_SCHEMA_LOCATION_NOT_UNDER_CHECKPOINT

Schema location '<schemaTrackingLocation>' must be placed under checkpoint location '<checkpointLocation>'.

We could not initialize the Delta streaming source schema log because

we detected an incompatible schema or protocol change while serving a streaming batch from table version <a> to <b>.

DELTA_STREAMING_SCHEMA_LOG_PARSE_SCHEMA_FAILED

Failed to parse the schema from the Delta streaming source schema log.

The schema log may have been corrupted. Please pick a new schema location.

DELTA_STREAMING_SINK_TRANSACTION_NOT_FOUND

No transaction found for batch <batchId> in streaming Delta sink in the last <versionLimit> versions.

DELTA_STREAMING_SKIP_OFFSETS_INVALID_OFFSET_RANGE

Invalid skip offset range for Delta source range=[<startOffset>, <endOffset>). Fix this offset range and try again.

For more details see DELTA_STREAMING_SKIP_OFFSETS_INVALID_OFFSET_RANGE

DELTA_STREAMING_TRAILING_COMMIT_MISSING

Delta stream detected commits up to version <expectedVersion> but files after version <seenVersion> are missing from the transaction log.

DELTA_TABLE_ALREADY_CONTAINS_CDC_COLUMNS

Unable to enable Change Data Capture on the table. The table already contains

reserved columns <columnList> that will

be used internally as metadata for the table's Change Data Feed. To enable

Change Data Feed on the table rename/drop these columns.

DELTA_TABLE_ALREADY_EXISTS

Table <tableName> already exists.

DELTA_TABLE_CHANGES_VIEW_REQUIRES_ROW_TRACKING

table_changes on view '<viewName>' is not supported because the underlying Delta table '<tableName>' does not have row tracking.

DELTA_TABLE_CHANGES_VIEW_UNSUPPORTED

table_changes on view '<viewName>' is not supported.

For more details see DELTA_TABLE_CHANGES_VIEW_UNSUPPORTED

DELTA_TABLE_CONTAINS_RESERVED_CDC_COLUMNS

Unable to compute Change Data Feed on the table. The table contains reserved column names <columnList> that are used as output columns for the table's Change Data Feed. To compute Change Data Feed on the table rename/drop these columns.

DELTA_TABLE_FOR_PATH_UNSUPPORTED_HADOOP_CONF

Currently DeltaTable.forPath only supports hadoop configuration keys starting with <allowedPrefixes> but got <unsupportedOptions>.

DELTA_TABLE_ID_MISMATCH

The Delta table at <tableLocation> has been replaced while this command was using the table.

Table id was <oldId> but is now <newId>.

Please retry the current command to ensure it reads a consistent view of the table.

DELTA_TABLE_INVALID_REDIRECT_STATE_TRANSITION

Unable to update table redirection state: Invalid state transition attempted.

The Delta table '<table>' cannot change from '<oldState>' to '<newState>'.

DELTA_TABLE_INVALID_SET_UNSET_REDIRECT

Unable to SET or UNSET redirect property on <table>: current property '<currentProperty>' mismatches with new property '<newProperty>'.

DELTA_TABLE_LOCATION_MISMATCH

The location of the existing table <tableName> is <existingTableLocation>. It doesn't match the specified location <tableLocation>.

DELTA_TABLE_NOT_FOUND

Delta table <tableName> doesn't exist.

DELTA_TABLE_NOT_SUPPORTED_IN_OP

Table is not supported in <operation>. Please use a path instead.

DELTA_TABLE_ONLY_OPERATION

<tableName> is not a Delta table. <operation> is only supported for Delta tables.

DELTA_TABLE_UNRECOGNIZED_REDIRECT_SPEC

The Delta log contains unrecognized table redirect spec '<spec>'.

DELTA_TARGET_TABLE_FINAL_SCHEMA_EMPTY

Target table final schema is empty.

DELTA_TIMESTAMP_EARLIER_THAN_COMMIT_RETENTION

SQLSTATE: 42816

The provided timestamp (<userTimestamp>) is before the earliest version available to

Expecting partition column <expectedCol>, but found partition column <parsedCol> from parsing the file name: <path>.

DELTA_UNEXPECTED_PARTITION_SCHEMA_FROM_USER

CONVERT TO DELTA was called with a partition schema different from the partition schema inferred from the catalog, please avoid providing the schema so that the partition schema can be chosen from the catalog.

catalog partition schema:

<catalogPartitionSchema>

provided partition schema:

<userPartitionSchema>

DELTA_UNIFORM_COMPATIBILITY_LOCATION_CANNOT_BE_CHANGED

delta.universalFormat.compatibility.location cannot be changed.

DELTA_UNIFORM_COMPATIBILITY_LOCATION_NOT_REGISTERED

delta.universalFormat.compatibility.location is not registered in the catalog.

DELTA_UNIFORM_COMPATIBILITY_MISSING_OR_INVALID_LOCATION

Missing or invalid location for Uniform compatibility format. Please set an empty directory for delta.universalFormat.compatibility.location.

Failed reason:

For more details see DELTA_UNIFORM_COMPATIBILITY_MISSING_OR_INVALID_LOCATION

DELTA_UNIFORM_ICEBERG_INGRESS_VIOLATION

Read Apache Iceberg with Delta Uniform has failed.

For more details see DELTA_UNIFORM_ICEBERG_INGRESS_VIOLATION

DELTA_UNIFORM_INGRESS_AMBIGUOUS_FORMAT

Multiple Delta Uniform ingress formats (<formats>) are found, at most one can be set.

DELTA_UNIFORM_INGRESS_NOT_SUPPORTED

Create or Refresh Uniform ingress table is not supported.

DELTA_UNIFORM_INGRESS_NOT_SUPPORTED_FORMAT

Format <fileFormat> is not supported. Only Apache Iceberg and hudi as original file format are supported.

DELTA_UNIFORM_INGRESS_VIOLATION

The validation of Universal Format (<format>) has failed: <violation>.

DELTA_UNKNOWN_CONFIGURATION

DELTA_UNSUPPORTED_ALTER_TABLE_CHANGE_COL_OP

ALTER TABLE CHANGE COLUMN is not supported for changing column <fieldPath> from <oldField> to <newField>.

DELTA_UNSUPPORTED_ALTER_TABLE_REPLACE_COL_OP

Unsupported ALTER TABLE REPLACE COLUMNS operation. Reason: <details>

Failed to change schema from:

<oldSchema>

to:

<newSchema>

DELTA_UNSUPPORTED_CATALOG_MANAGED_TABLE_OPERATION

<operation> is blocked by the catalog for Catalog-Managed tables.

DELTA_UNSUPPORTED_CHANGE_ON_COLUMNS_WITH_INDEX

Cannot alter column(s) <quotedColumnNames> because they are part of one or more indexes. Drop the index(es) first, then retry the operation.

DELTA_UNSUPPORTED_CLONE_REPLACE_SAME_TABLE

You tried to REPLACE an existing table (<tableName>) with CLONE. This operation is

unsupported. Try a different target for CLONE or delete the table at the current target.

DELTA_UNSUPPORTED_CLUSTERING_COLUMN_PREDICATES

<command> command for Liquid tables does not support the provided predicates:

For more details see DELTA_UNSUPPORTED_CLUSTERING_COLUMN_PREDICATES

DELTA_UNSUPPORTED_COLUMN_MAPPING_MODE_CHANGE

Changing column mapping mode from '<oldMode>' to '<newMode>' is not supported.

DELTA_UNSUPPORTED_COLUMN_MAPPING_OPERATIONS_ON_COLUMNS_WITH_BLOOM_FILTER_INDEX

Failed to perform Column Mapping operation <opName> on column(s) <quotedColumnNames>

because these column(s) have Bloom Filter Index(es).

If you want to perform Column Mapping operation on column(s)

with Bloom Filter Index(es),

please remove the Bloom Filter Index(es) first:

DROP BLOOMFILTER INDEX ON TABLE tableName FOR COLUMNS(<columnNames>)

If you want instead to remove all Bloom Filter Indexes on the table, use:

DROP BLOOMFILTER INDEX ON TABLE tableName

DELTA_UNSUPPORTED_COLUMN_MAPPING_PROTOCOL

Your current table protocol version does not support changing column mapping modes

using <config>.

Required Delta protocol version for column mapping:

<requiredVersion>

Your table's current Delta protocol version:

<currentVersion>

<advice>

DELTA_UNSUPPORTED_COLUMN_MAPPING_SCHEMA_CHANGE

Schema change is detected:

Updating nested fields is only supported for StructType, but you are trying to update a field of <columnName>, which is of type: <dataType>.

DELTA_UNSUPPORTED_FILE_SYSTEM

The file system for path <path> is not supported. Please verify that the file system scheme in the path is spelled correctly and that your environment is configured with the required dependencies and settings for this file system.

DELTA_UNSUPPORTED_FSCK_WITH_DELETION_VECTORS

The 'FSCK REPAIR TABLE' command is not supported on table versions with missing deletion vector files.

Please contact support.

DELTA_UNSUPPORTED_GENERATE_WITH_DELETION_VECTORS

The 'GENERATE symlink_format_manifest' command is not supported on table versions with deletion vectors.

In order to produce a version of the table without deletion vectors, run 'REORG TABLE table APPLY (PURGE)'. Then re-run the 'GENERATE' command.

because these columns have Bloom Filter Index(es).

If you want to change the data type of column(s) with Bloom Filter Index(es),

please remove the Bloom Filter Index(es) first:

DROP BLOOMFILTER INDEX ON TABLE tableName FOR COLUMNS(<columnNames>)

If you want instead to remove all Bloom Filter Indexes on the table, use:

DROP BLOOMFILTER INDEX ON TABLE tableName

DELTA_UNSUPPORTED_VACUUM_SPECIFIC_PARTITION

Please provide the base path (<baseDeltaPath>) when Vacuuming Delta tables. Vacuuming specific partitions is currently not supported.

DELTA_UNSUPPORTED_WRITES_STAGED_TABLE

SQLSTATE: 42807

Table implementation does not support writes: <tableName>.

DELTA_UNSUPPORTED_WRITES_WITHOUT_COORDINATOR

You are trying to perform writes on a table which has been registered with the commit coordinator <coordinatorName>. However, no implementation of this coordinator is available in the current environment and writes without coordinators are not allowed.

DELTA_UNSUPPORTED_WRITE_SAMPLE_TABLES

Write to sample tables is not supported.

DELTA_UPDATE_SCHEMA_MISMATCH_EXPRESSION

Cannot cast <fromCatalog> to <toCatalog>. All nested columns must match.

DELTA_USER_DEFINED_TYPE_COLUMN_CONTAINS_NULL_TYPE

SQLSTATE: 22005

Found NullType in column <columnName> which is of <userClass> user-defined type. Delta doesn't support writing NullType in user-defined types.

DELTA_V2_CHECKPOINTS_REQUIRED_FOR_OPERATION

CHECKPOINT operation is not supported on table <tableNameOrPath> without V2 Checkpoints.

DELTA_VACUUM_COPY_INTO_STATE_FAILED

VACUUM on data files succeeded, but COPY INTO state garbage collection failed.

DELTA_VACUUM_RETENTION_PERIOD_NEGATIVE

Retention period for Vacuum can't be less than 0 hours.

DELTA_VACUUM_RETENTION_PERIOD_TOO_SHORT

The specified VACUUM retention period is too low and may corrupt this Delta table if any writes are in progress.

If no operations (insert, upsert, delete, optimize) are running, you can disable this safety check by setting:

delta.retentionDurationCheck.enabled = false

Otherwise, use a retention period of at least <configuredRetentionHours> hours.

DELTA_VERSIONS_NOT_CONTIGUOUS

SQLSTATE: KD00C

Versions (<versionList>) are not contiguous.

A gap in the delta log between versions <startVersion> and <endVersion> was detected while trying to load version <versionToLoad>.

For more details see DELTA_VERSIONS_NOT_CONTIGUOUS

DELTA_VERSION_INVALID

SQLSTATE: 42815

The provided version (<version>) is not a valid version.

DELTA_VERSION_NOT_FOUND

Cannot time travel Delta table to version <userVersion>. Available versions: [<earliest>, <latest>].

DELTA_VIOLATE_CONSTRAINT_WITH_VALUES

SQLSTATE: 23001

CHECK constraint <constraintName> <expression> violated by row with values:

<values>.

DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED

The validation of the properties of table <table> has been violated:

For more details see DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED

DELTA_WRITE_INTO_VIEW_NOT_SUPPORTED

<viewIdentifier> is a view. You may not write data into a view.

DELTA_ZORDERING_COLUMN_DOES_NOT_EXIST

Z-Ordering column <columnName> does not exist in data schema.

DELTA_ZORDERING_ON_COLUMN_WITHOUT_STATS

SQLSTATE: KD00D

Z-Ordering on <cols> will be ineffective, because we currently do not collect stats for these columns. Please refer to <link> for more information on data skipping and z-ordering. You can disable this check by setting

SET <zorderColStatKey> = false

DELTA_ZORDERING_ON_PARTITION_COLUMN

SQLSTATE: none assigned

The provided securable kind <securableKind> does not support rotate token action initiated by Marketplace service.

DELTA_SHARING_SECURABLE_DELETE_BLOCKED

Schema evolution mode <addNewColumnsMode> is not supported when the schema is specified. To use this mode, you can provide the schema through cloudFiles.schemaHints instead.

CF_AMBIGUOUS_AUTH_OPTIONS_ERROR

Found notification-setup authentication options for the (default) directory

listing mode:

<options>

If you wish to use the file notification mode, please explicitly set:

.option("cloudFiles.<useNotificationsKey>", "true")

Alternatively, if you want to skip the validation of your options and ignore these

Failed to create an Event Grid subscription. Please make sure that your service

principal has <permissionType> Event Grid Subscriptions. See more details at:

<docLink>

CF_EVENT_GRID_CREATION_FAILED

Failed to create event grid subscription. Please ensure that Microsoft.EventGrid is

registered as resource provider in your subscription. See more details at:

<docLink>

CF_EVENT_GRID_NOT_FOUND_ERROR

Failed to create an Event Grid subscription. Please make sure that your storage

account (<storageAccount>) is under your resource group (<resourceGroup>) and that

the storage account is a "StorageV2 (general purpose v2)" account. See more details at:

<docLink>

CF_EVENT_NOTIFICATION_NOT_SUPPORTED

Auto Loader event notification mode is not supported for <cloudStore>.

CF_EVENT_NOTIFICATION_SETUP_FAILED

Failed to infer schema for format <fileFormatInput> from existing files in input path <path>.

For more details see CF_FAILED_TO_INFER_SCHEMA

CF_FAILED_TO_WRITE_TO_SCHEMA_LOG

Failed to write to the schema log at location <path>.

CF_FGAC_VOLUME_MODE_NOT_SUPPORTED

You are using Auto Loader with a file discovery mode that is not supported for volume '<path>' because you only have partial access to this volume. Only directory listing mode is supported. Please set cloudFiles.useNotifications to false and cloudFiles.useManagedFileEvents to false.

CF_FILE_FORMAT_REQUIRED

Could not find required option: cloudFiles.format.

CF_FOUND_MULTIPLE_AUTOLOADER_PUBSUB_SUBSCRIPTIONS

Found multiple (<num>) subscriptions with the Auto Loader prefix for topic <topicName>:

<subscriptionList>

There should only be one subscription per topic. Please manually ensure that your topic does not have multiple subscriptions.

CF_GCP_AUTHENTICATION

Please either provide all of the following: <clientEmail>, <client>,

<privateKey>, and <privateKeyId> or provide <serviceCredential> to use your Databricks service credential.

Alternatively, provide none of them in order to use the default GCP credential provider chain for authenticating with GCP resources.

CF_GCP_LABELS_COUNT_EXCEEDED

Received too many labels (<num>) for GCP resource. The maximum label count per resource is <maxNum>.

CF_GCP_RESOURCE_TAGS_COUNT_EXCEEDED

Received too many resource tags (<num>) for GCP resource. The maximum resource tag count per resource is <maxNum>, as resource tags are stored as GCP labels on resources, and Databricks specific tags consume some of this label quota.

CF_GDRIVE_CHANGE_FEED_SUBFOLDER_NOT_SUPPORTED

SQLSTATE: 42KDB

Google Drive change feed requires a drive root path, but received a subfolder path (fileId=<fileId>).

The Google Drive Changes API operates at the drive level and cannot be scoped to a subfolder.

Use the drive root URL instead.

CF_INCOMPLETE_LOG_FILE_IN_SCHEMA_LOG

Incomplete log file in the schema log at path <path>

We recommend that you remove these options and then restart the stream.

CF_INVALID_MANAGED_FILE_EVENTS_RESPONSE

Invalid response from managed file events service. Please contact Databricks support for assistance.

For more details see CF_INVALID_MANAGED_FILE_EVENTS_RESPONSE

CF_INVALID_SCHEMA_EVOLUTION_MODE

cloudFiles.<schemaEvolutionModeKey> must be one of {

"<addNewColumnsWithTypeWidening>"

"<addNewColumns>"

"<failOnNewColumns>"

"<rescue>"

"<noEvolution>"}

CF_INVALID_SCHEMA_HINTS_OPTION

Schema hints can only specify a particular column once.

In this case, redefining column: <columnName>

multiple times in schemaHints:

<schemaHints>

CF_INVALID_SCHEMA_HINT_COLUMN

CF_MISSING_METADATA_FILE_ERROR

The metadata file in the streaming source checkpoint directory is missing. This metadata

file contains important default options for the stream, so the stream cannot be restarted

right now. Please contact Databricks support for assistance.

CF_MISSING_PARTITION_COLUMN_ERROR

CF_PREFIX_MISMATCH

Found mismatched event: key <key> doesn't have the prefix: <prefix>

CF_PROTOCOL_MISMATCH

<message>

If you don't need to make any other changes to your code, then please set the SQL

configuration: '<sourceProtocolVersionKey> = <value>'

to resume your stream. Please refer to:

<docLink>

for more details.

CF_READ_CHANGE_FEED_UNSUPPORTED

Either password or key file must be specified for SFTP.

Please specify the password in the source uri or via <passwordOption>, or specify the key file content via <keyFileOption>.

CF_SFTP_NOT_ENABLED

Accessing SFTP files is not enabled. Please contact Databricks support for assistance.

CF_SFTP_REQUIRE_FULL_PATH

Specify the full path components for an SFTP source in the form of sftp://$user@$host:$port/$path to ensure accurate UC connection look up.

CF_SFTP_REQUIRE_UC_CLUSTER

An UC-enabled cluster is required to access SFTP files. Please contact Databricks support for assistance.

CF_SFTP_USERNAME_NOT_FOUND

<optionList>

ST_DIFFERENT_SRID_VALUES

Arguments to "<sqlFunction>" must have the same SRID value. SRID values found: <srid1>, <srid2>

ST_INVALID_ARGUMENT

Unity Catalog

CANNOT_DROP_ABAC_MASKED_COLUMN

Cannot drop column(s) <columnNames> because an ABAC column mask policy applies to them. Run SHOW EFFECTIVE POLICIES to find the policy, then remove it, amend its MATCH COLUMNS condition, or remove the matching column tags before dropping the column. For guidance please refer to the documentation <docLink>.

CANNOT_DROP_ABAC_ROW_FILTER_COLUMN

Cannot drop column(s) <columnNames> because an ABAC row filter policy depends on them. Run SHOW EFFECTIVE POLICIES to find the policy, then remove it, amend its MATCH COLUMNS condition, or remove the matching column tags before dropping the column. For guidance please refer to the documentation <docLink>.

CANNOT_DROP_MASKED_COLUMN

Cannot drop column(s) <columnNames> because they have a column mask. Please remove the column mask(s) before dropping the column. For guidance please refer to the documentation <docLink>.

CANNOT_DROP_TAGGED_COLUMN

Column cannot be dropped because it has one or more governed tags assigned. Please remove the tag(s) before dropping the column. For guidance please refer to the documentation <docLink>.

CANNOT_RENAME_MASKED_COLUMN

Cannot rename column(s) <columnNames> because they have a column mask. Please remove the column mask(s) before renaming the column. For guidance please refer to the documentation <docLink>.

CHILD_CREATION_FORBIDDEN_FOR_FOREIGN_SECURABLE

Securable <childSecurableName> of type <childSecurableType> cannot be created in parent <parentSecurableName> of kind <parentSecurableKind>.

COLUMN_FORMAT_INCOMPATIBLE_WITH_COLUMN_TYPE

Column <columnName> has <formatType> format which is incompatible with column type <columnType>.

CONFLICTING_COLUMN_NAMES_ERROR

Column <columnName> conflicts with another column with the same name but with/without trailing whitespaces (for example, an existing column named <columnName> ). Please rename the column with a different name.

CONNECTION_CREDENTIALS_NOT_SUPPORTED_FOR_ONLINE_TABLE_CONNECTION

Invalid request to get connection-level credentials for connection of type <connectionType>. Such credentials are only available for managed PostgreSQL connections.

CONNECTION_TYPE_NOT_ENABLED

Connection type '<connectionType>' is not enabled. Please enable the connection to use it.

DELTA_SHARING_PROVISIONING_STATE_NOT_ACTIVE

The shared entity '<securableFullName>' is currently not usable, because it has not been fully synchronized with the corresponding source entity yet. Caused by: <reason>.

DELTA_SHARING_READ_ONLY_RECIPIENT_EXISTS

There is already a Recipient object '<existingRecipientName>' with the same sharing identifier '<existingMetastoreId>'.

DELTA_SHARING_READ_ONLY_SECURABLE_KIND

Data of an OpenSharing Securable Kind <securableKindName> are read-only and can not be created, modified or deleted.

DELTA_SHARING_SYSTEM_TABLE_PROVIDER_MOUNT_NOT_ALLOWED

Mounting a OpenSharing share from the system tables provider is not allowed.

DISASTER_RECOVERY_READ_ONLY

SQLSTATE: 25006

The requested operation cannot be completed because catalog <catalogName> is in the secondary region for Managed Disaster Recovery. Secondary catalogs are read-only. Perform write operations in the primary region.

DISASTER_RECOVERY_RENAME_NOT_ALLOWED

Catalog <catalogName> cannot be renamed because it is part of a Disaster Recovery failover group. Remove the catalog from Disaster Recovery before attempting to rename it.

EXTERNAL_ACCESS_DISABLED_ON_METASTORE

External Data Access from non Databricks Compute environment is disabled for metastore <metastoreName>. Please contact your metastore admin to enable 'External Data Access' configuration on the metastore.

EXTERNAL_ACCESS_NOT_ALLOWED_FOR_TABLE

Table with id <tableId> cannot be accessed from outside of Databricks Compute Environment due to its kind being <securableKind>. Only 'TABLE_EXTERNAL', 'TABLE_DELTA_EXTERNAL' and 'TABLE_DELTA' table kinds can be accessed externally.

EXTERNAL_USE_SCHEMA_ASSIGNED_TO_INCORRECT_SECURABLE_TYPE

Privilege EXTERNAL USE SCHEMA is not applicable to this entity <assignedSecurableType> and can only be assigned to a schema or catalog. Please remove the privilege from the <assignedSecurableType> object and assign it to a schema or catalog instead.

EXTERNAL_WRITE_NOT_ALLOWED_FOR_TABLE

Table with id <tableId> cannot be written from outside of Databricks Compute Environment due to its kind being <securableKind>. Only 'TABLE_EXTERNAL' and 'TABLE_DELTA_EXTERNAL' table kinds can be written externally.

FOREIGN_CATALOG_STORAGE_ROOT_MUST_SUPPORT_WRITES

The storage location for a foreign catalog of type <catalogType> will be used for unloading data and can not be read-only.

HMS_SECURABLE_OVERLAP_LIMIT_EXCEEDED

The number of <resourceType>s for input path <url> exceeds the allowed limit (<overlapLimit>) for overlapping HMS <resourceType>s.

INVALID_DATASOURCE_FORMAT

Data source format '<datasourceFormat>' is not supported<tableTypeSuffix> <catalogKindSuffix>.

INVALID_NAME_FORMAT

<fieldDescription> is not a valid name. Valid names cannot contain spaces, periods, forward slashes, or control characters.

INVALID_RESOURCE_NAME_DELTA_SHARING

OpenSharing requests are not supported using resource names

INVALID_RESOURCE_NAME_ENTITY_TYPE

The provided resource name references entity type <provided> but expected <expected>

INVALID_RESOURCE_NAME_METASTORE_ID

The provided resource name references a metastore that is not in scope for the current request

INVALID_SECURABLE_NAME

<rpcName> invalid <securableType> name: '<securableFullName>'

LOCATION_OVERLAP

Input path url '<path>' overlaps with <overlappingLocation> within '<caller>' call. <conflictingSummary>. <permissionErrorSuggestion>

LOCATION_OVERLAP_STORAGE_CONFLICT_WITH_WORKSPACE_STORAGE

Customer-defined storage location conflicts with the workspace default storage '<path>' during '<caller>' operation. This prevents features that rely on workspace storage from operating. Conflict summary: <conflictingSummary>. See https://docs.databricks.com/aws/en/data-governance/unity-catalog/storage-conflicts for remediation steps.

LOCATION_OVERLAP_WITH_ACCOUNT_STORAGE_CONFIGURATION

The external location path '<path>' conflicts with a storage configuration in your account during '<caller>' operation. External locations must not overlap with storage used by workspaces in your account, as this can prevent internal features from operating correctly. To resolve, use a more specific subpath (for example, 's3://bucket/my-data/' instead of 's3://bucket/'). See https://docs.databricks.com/aws/en/data-governance/unity-catalog/storage-conflicts for details.

MANAGED_TABLE_FORMAT

Only Delta is supported for managed tables. Provided datasource format is <datasourceFormat>.

METASTORE_DOES_NOT_EXIST

No metastore assigned for the current workspace.

METASTORE_UPDATE_NOT_ALLOWED_FOR_NON_SAP_PRINCIPAL

Metastore update is not permitted in SAP Databricks accounts.

MONGO_DB_SRV_CONNECTION_STRING_DOES_NOT_ALLOW_PORT

Creating or updating a MongoDB connection is not allowed because MongoDB SRV connection string does not require port.

Please remove port, since SRV connection string does not require port.

NESTED_SCHEMA_INVALID_CATALOG_ID

schema is nested; use parent_type and parent_id from the schema detail change event to identify the schema parent instead of resolving catalog_id.

PRINCIPAL_DOES_NOT_EXIST

Could not find principal with name <principalName>.

PRIVILEGES_SUPPORT_NOT_ENABLED

Privileges support is not enabled for type [<typeString>]

PRIVILEGE_NOT_APPLICABLE_TO_ENTITY

Privilege <privilege> is not applicable to this entity [<classifier>]. If this seems unexpected, please check the privilege version of the metastore in use [<privilegeVersion>].

READ_ONLY_CATALOG

Data inside an OpenSharing Catalog are read-only and can not be created, modified or deleted. Catalog '<catalogName>' is an OpenSharing Catalog.

REDSHIFT_FOREIGN_CATALOG_STORAGE_ROOT_MUST_BE_S3

The storage root for Redshift foreign catalog has to be AWS S3.

SCHEMA_NOT_EMPTY

Schema '<fullName>' is not empty. <extraInfo>

SECURABLE_KIND_DOES_NOT_SUPPORT_LAKEHOUSE_FEDERATION

Securable with kind <securableKind> does not support Lakehouse Federation.

SECURABLE_KIND_NOT_ENABLED

Securable kind '<securableKind>' is not enabled. If this is a securable kind associated with a preview feature, please enable it in workspace settings.

SECURABLE_TYPE_DOES_NOT_SUPPORT_LAKEHOUSE_FEDERATION

Securable with type <securableType> does not support Lakehouse Federation.

SOURCE_TABLE_COLUMN_COUNT_EXCEEDS_LIMIT

The source table has more than <columnCount> columns. Please reduce the number of columns to <columnLimitation> or fewer.

SYSTEM_SERVICE_PRINCIPAL_IS_NOT_REGISTERED

Could not find the registered system service principal with resource name <servicePrincipalResource>.

TABLE_TYPE_DOES_NOT_SUPPORT_COLUMN_METADATA

Table type <tableType> does not support column metadata.

UC_AAD_CLIENT_SECRET_EXPIRED_FOR_SERVICE_PRINCIPAL

The client secret keys for service principal with application id <applicationId> are expired. Visit the Azure portal to create new keys for your service principal.

UC_AAD_CLIENT_SECRET_EXPIRED_FOR_STORAGE_CREDENTIAL

The client secret keys for storage credential <storageCredentialName> are expired. Contact the owner or your account admin to update the storage credential.

UC_AAD_CLIENT_SECRET_INVALID_FOR_SERVICE_PRINCIPAL

The client secret key for the service principal with application id <applicationId> is not valid.

UC_AAD_SERVICE_PRINCIPAL_CONFIG_INVALID

Service principal configuration is not valid. Verify the Directory ID, Application ID, and Client Secret.

UC_AAD_TOKEN_EXCHANGE_GENERIC_FAILURE

Failed to get credentials: Storage Credential <storageCredentialName> is not configured correctly. Contact the owner or your account admin to update the configuration.

UC_AAD_TOKEN_LIFETIME_TOO_SHORT

Exchanged AAD token lifetime is <lifetime> which is configured too short. Please check your Azure AD setting to make sure temporary access token has at least an hour lifetime. https://learn.microsoft.com/azure/active-directory/develop/active-directory-configurable-token-lifetimes

UC_ABAC_AMBIGUOUS_COLUMN_MATCH

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' failed with message: Using alias '<alias>' had <size> matches, exactly 1 match is allowed.

UC_ABAC_AND_NATIVE_ROW_FILTERS

Evaluation of ABAC policies on '<resource>' resulted in multiple row filters. The native row filter '<nativeRowFilterFunction>' and the following ABAC policies each apply a row filter: <policyNames>. At most one row filter is allowed.

UC_ABAC_BUILTIN_FUNCTION_DISABLED

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' uses builtin function '<functionName>' which is not currently enabled.

UC_ABAC_BUILTIN_FUNCTION_NOT_ALLOWED

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' uses builtin function '<functionName>' which is not allowed for this policy type.

UC_ABAC_CONTEXT_ATTRIBUTE_FUNCTIONS_DISABLED

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' uses context attribute functions which are not currently enabled.

UC_ABAC_DEPENDENCY_COMPLEXITY_LIMIT_EXCEEDED

<resourceType> '<ref>' has too many <resolverType> abac dependencies.

UC_ABAC_DEPENDENCY_DIFFERING_RF_CM

Dependency '<dependency>' is referenced multiple times and resulted in differing ABAC row filters or column masks.

UC_ABAC_EVALUATION_USER_ERROR

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' failed with message: <message>.

UC_ABAC_IDENTITY_ATTRIBUTES_UNAVAILABLE

Error evaluating ABAC policies on '<resource>'. Please retry; if the issue persists, contact Databricks support and reference this error class.

UC_ABAC_INVALID_TAG_POLICY_VALUE

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' references invalid tag value <tagValue> for key <tagKey>. Ensure the governed tag value is valid.

UC_ABAC_MULTIPLE_ROW_FILTERS

Evaluation of ABAC policies on '<resource>' resulted in multiple row filters. The following policies each apply a row filter: <policyNames>. At most one row filter is allowed.

UC_ABAC_SESSION_IDENTITY_REQUIRED

This query requires session identity behavior, which is not enabled for this account. Session identity behavior became the default on April 28, 2026. To run this query, ask an account admin to enable session identity behavior. Please follow the guidance at https://databricks.helpjuice.com/en_US/upcoming-change-to-abac-policy-evaluation-for-tables-accessed-through-views-and-functions

UC_ABAC_TAG_INTROSPECTION_DISABLED

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' uses tag introspection which is not currently enabled.

UC_ABAC_UNKNOWN_CONTEXT_ATTRIBUTE_KEY

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' references unknown context attribute key: <key>. Use a supported request.* context attribute.

UC_ABAC_UNKNOWN_TAG_POLICY

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' references unknown tag: <tagKey>. Ensure the governed tag exists.

UC_ABAC_UNMATCHED_ALIAS_IN_USING_COLUMNS

Error evaluating ABAC policies on '<resource>'. Failed with message: Alias '<alias>' used in USING COLUMNS did not match any column.

UC_ABAC_UNMATCHED_ON_COLUMN_ALIAS

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' failed with message: Alias '<alias>' used in ON COLUMN did not match any column.

UC_ABAC_UNMATCHED_USING_ALIAS

Error evaluating ABAC policies on '<resource>'. Policy '<policyName>' failed with message: Using alias '<alias>' does not have matched column.

UC_ABAC_USING_REF_OF_NATIVE_MASKED_COLUMNS

Error evaluating ABAC policies on '<resource>'. Failed with message: Column '<usingCol>' has been masked by native RLS/CM policy '<nativeFunction>' and cannot be used as an input to the ABAC policy '<policyName>'.

UC_ACCESS_REQUIRES_WORKSPACE

Unable to access workspace-bound securable because the user is not assigned to the associated workspace.

UC_ALTER_DLT_VIEW_OUTSIDE_DEFINING_PIPELINE

Altering the view '<viewFullName>' outside of the pipeline that defined it is not allowed. Instead, update the view definition from the pipeline that defined it (Pipeline ID: <owningPipelineId>).

UC_ATLAS_NOT_ENABLED_FOR_CALLING_SERVICE

Atlas is not enabled for the calling service <serviceName>.

UC_AUTHZ_ACTION_NOT_SUPPORTED

Authorizing <actionName> is not supported; please check that the RPC invoked is implemented for this resource type

UC_AWS_ASSUME_ROLE_FAILED

Failed to get credentials: the AWS IAM role in the Unity Catalog credential is not configured correctly. Please contact your metastore admin or the credential owner to update the configuration in AWS.

UC_AWS_EMPTY_STORAGE_LOCATION

Empty storage location.

UC_AWS_INVALID_S3_POLICY_PREFIX

Invalid s3 path for storage location: S3 path <providedPath> does not start with the expected prefix: <expectedPrefix>.

UC_AWS_UNSUPPORTED_S3_SCHEME

Invalid s3 path for storage location: Unsupported scheme found: <providedScheme>. Supported Schemes are: <supportedS3Schemes>.

UC_AZURE_BLOB_SERVICE_UNAVAILABLE

SQLSTATE: 57P03

Azure Blob service is temporarily unavailable. Try again later.

UC_AZURE_CREDENTIAL_NOT_FOUND

Azure storage credential was not found. The access connector may have been deleted or recreated. Contact your account admin to reconfigure the storage credential. Details: <details>

UC_AZURE_GOVCLOUD_LEGACY_NOT_SUPPORTED

Unity Catalog is not supported in the legacy Azure Government Cloud (AZURE_US_GOVERNMENT).

UC_AZURE_MANAGED_IDENTITY_CREDENTIAL_NOT_FOUND

Azure Managed Identity Credential with Access Connector Id <accessConnectorId> and Managed Identity ID: <managedIdentityId> for Account Id: <accountId> could not be found.

UC_AZURE_UDK_UNAUTHORIZED

Request for user delegation key is not authorized. Details: <details>

UC_BUILTIN_HMS_CONNECTION_CREATION_PERMISSION_DENIED

Cannot create a connection for a builtin hive metastore because user: <userId> is not the admin of the workspace: <workspaceId>

UC_BUILTIN_HMS_CONNECTION_MODIFY_RESTRICTED_FIELD

Attempt to modify a restricted field in built-in HMS connection '<connectionName>'. Only 'warehouse_directory' can be updated.

UC_CANNOT_DELETE_TABLE_WITH_ACTIVE_SHALLOW_CLONES

Cannot delete table '<tableFullName>' because it is referenced by <cloneCount> active shallow clone(s). Drop all shallow clones before deleting the base table.

UC_CANNOT_REMOVE_CATALOG_MANAGED_OUTSIDE_DELTA_COMMIT

The update to table '<tableFullName>' would remove the catalogManaged feature or the io.unitycatalog.tableId property, which is not allowed. They can only be removed through the catalog-managed downgrade path.

UC_CANNOT_RENAME_PARTITION_FILTERING_COLUMN

SQLSTATE: 428FR

Failed to rename table column <originalLogicalColumn> because it's used for partition filtering in <sharedTableName>. In order to proceed, you can remove the table from the share, rename the column, and share it with the desired partition filtering columns again. Though, this may break the streaming query for your recipient.

UC_CHILD_COLUMNS_ALREADY_EXIST_IN_PRIMARY_KEY_OR_UNIQUE_CONSTRAINT

SQLSTATE: 42891

Failed to create <newConstraintType> constraint <newConstraintName>: table <tableName> already has a <existingConstraintType> constraint: <existingConstraintName>, that has the same set of child columns.

UC_CHILD_CREATION_FORBIDDEN_FOR_NON_UC_CLUSTER

Cannot create <securableType> '<securable>' under <parentSecurableType> '<parentSecurable>' because the request is not from a UC cluster.

UC_CLOUD_STORAGE_ACCESS_FAILURE

Failed to access cloud storage: <errMsg> exceptionTraceId=<exceptionTraceId>

UC_COMMIT_TRANSACTION_OPERATION_USING_MST_NOT_SUPPORTED

<operationType> are only allowed as single-table commits, and cannot be done within a multi-table transaction.

UC_CONFLICTING_CONNECTION_ALLOW_LIST_OPTIONS

Cannot create a connection with an allow list that overlaps with a connection option. Value: <conflictingOptions>

UC_CONFLICTING_CONNECTION_OPTIONS

Cannot create a connection with both username/password and oauth authentication options. Please choose one.

UC_CONNECTION_ACCESS_TOKEN_REQUEST_FAILED

Failed to obtain a fresh access token from the identity provider. Make sure the connection's credentials are correct and the identity provider is reachable.

UC_CONNECTION_CREDENTIALS_MAXIMUM_REACHED

The maximum number of credentials for connection name '<connectionName>' has been reached. Please delete existing credentials before creating a new one.

UC_CONNECTION_CREDENTIALS_NOT_EXIST_FOR_USER_WITH_LOGIN

SQLSTATE: 42517

Credential for user identity('<userIdentity>') is not found for the connection '<connectionName>'. Please login first to the connection by visiting <connectionPage>

UC_CONNECTION_CREDENTIALS_TYPE_NOT_SUPPORTED

Creating credentials for securable type '<securableType>' is not supported. Supported securable types: <allowedSecurableType>.

UC_CONNECTION_DEPENDENCY_PATH_INVALID

Invalid dependency path: <reason>

UC_CONNECTION_ENVIRONMENT_VERSION_INVALID

Invalid environment version: <reason>

UC_CONNECTION_ENVIRONMENT_VERSION_NOT_SUPPORTED

Environment version is not currently supported. Provided: <environmentVersion>

UC_CONNECTION_EXISTS_FOR_CREDENTIAL

Credential '<credentialName>' has one or more dependent connections. You may use force option to continue to update or delete the credential, but the connections using this credential may not work anymore.

UC_CONNECTION_EXPIRED_REFRESH_TOKEN

The refresh token associated with the connection is expired. Please update the connection to restart the OAuth flow to retrieve a fresh token.

UC_CONNECTION_INVALID_CREDENTIAL_TYPE

The selected credential type for <connectionType> UC connection is not allowed. Allowed credential types: <allowedCredentialTypes>.

UC_CONNECTION_IN_FAILED_STATE

The connection is in the FAILED state. Please update the connection with valid credentials to reactivate it.

UC_CONNECTION_MISSING_OPTION

Connections of securable type '<securableType>' must include the following option(s): <requiredOptions>.

UC_CONNECTION_MISSING_REFRESH_TOKEN

There is no refresh token associated with the connection. Please update the OAuth client integration in your identity provider to return refresh tokens, and update or recreate the connection to restart the OAuth flow and retrieve the necessary tokens.

UC_CONNECTION_OAUTH_EXCHANGE_FAILED

The OAuth token exchange failed with HTTP status code <httpStatus>. The returned server response or exception message is: <response>

UC_CONNECTION_OPTION_NOT_SUPPORTED

Connections of securable type '<securableType>' do not support the following option(s): <optionsNotSupported>. Supported options: <allowedOptions>.

UC_CONNECTION_OPTION_SANITIZER_REJECTED

Invalid value for connection option '<option>': <reason>

UC_COORDINATED_COMMITS_BACKFILL_ONLY_NO_EXISTING_COMMITS

Backfill-only commit is invalid: table <tableFullName> has no existing commits.

UC_COORDINATED_COMMITS_NOT_ENABLED

Supports for coordinated commits is not enabled. Please contact Databricks support.

UC_CREATE_FORBIDDEN_UNDER_INACTIVE_SECURABLE

Cannot create <securableType> '<securableName>' because it is under a <parentSecurableType> '<parentSecurableName>' that is not active. Please delete the parent securable and recreate the parent.

UC_CREDENTIAL_ACCESS_CONNECTOR_PARSING_FAILED

Failed to parse the provided access connector ID: <accessConnectorId>. Please verify its formatting and try again.

UC_CREDENTIAL_FAILED_TO_OBTAIN_VALIDATION_TOKEN

Failed to obtain an AAD token to perform cloud permission validation on an access connector. Please retry the action.

UC_CREDENTIAL_INVALID_CLOUD_PERMISSIONS

Registering a credential requires the contributor role over the corresponding access connector with ID <accessConnectorId>. Please contact your account admin.

UC_CREDENTIAL_INVALID_CREDENTIAL_TYPE_FOR_FILE_EVENT_OPERATION

Storage credential type '<credentialType>' cannot be used for file event operation '<operation>'. The credential's cloud provider must match the file event queue type — use an Azure managed identity or service principal credential for Azure file event queues, an AWS IAM role for AWS, and a service account credential for GCP.

UC_CREDENTIAL_INVALID_CREDENTIAL_TYPE_FOR_PURPOSE

Credential type '<credentialType>' is not supported for purpose '<credentialPurpose>'

UC_CREDENTIAL_MI_IS_MISSING_READER_ROLE

Registering a credential requires managed identity (MI) to have a Reader role scoped to MI itself for <accessConnectorId>. Please contact your account admin.

UC_CREDENTIAL_PERMISSION_DENIED

Only the account admin can create or update a credential with type <storageCredentialType>.

UC_CREDENTIAL_TRUST_POLICY_IS_OPEN

The trust policy of the IAM role to allow Databricks Account to assume the role should require an external id. Please contact your account admin to add the external id condition. This behavior is to guard against the Confused Deputy problem (https://docs.aws.amazon.com/IAM/latest/UserGuide/confused-deputy.html).

UC_CREDENTIAL_TYPE_NOT_SUPPORTED_FOR_EXTERNAL_CALLERS

Storage credential '<credentialName>' cannot be used from outside of Databricks Unity Catalog enabled compute environment. Please contact Databricks support for integrations with Unity Catalog.

UC_CREDENTIAL_WORKSPACE_API_PROHIBITED

Creating or updating a credential as a non-account admin is not supported in the account-level API. Please use the workspace-level API instead.

UC_CROSS_REGION_CACHE_REGION_MISMATCH

The cache location region <cacheRegion> does not match the workspace region <workspaceRegion>.

UC_DBFS_KIND_OUT_OF_AUTHORIZED_PATHS_SCOPE

Authorized Path Error. The <securableType> location <location> is not defined within the authorized paths for catalog: <catalogName>. Please ask the catalog owner to add the path to the list of authorized paths defined on the catalog. Then, run REFRESH FOREIGN SCHEMA schema_name RESOLVE DBFS LOCATION (for a schema and its dependents) or REFRESH FOREIGN TABLE table_name RESOLVE DBFS LOCATION (for a single table) to resolve the DBFS location and bring the entity to the ACTIVE state.

UC_DBR_TRUST_VERSION_TOO_OLD

The Databricks Runtime being used no longer supports this operation. Please use the latest version (you may just need to restart your cluster).

UC_DELETED_USER_IN_POLICY_EVALUATION

Cannot evaluate ABAC policies: <principalType> principal <userId> is deleted.

UC_DELTA_ILLEGAL_BACKFILLED_VERSION

Unexpected latestBackfilledVersion <latestBackfilledVersion> on the commit (<version>, <commitType>).

UC_DELTA_ILLEGAL_CONCURRENT_MIGRATION

Table '<tableId>': Concurrent upgrade or downgrade to/from a catalog-managed table is not supported. Ensure that only one transaction runs the migration command at a time. A duplicate <commitType> was detected at version <version>.

UC_DELTA_ILLEGAL_MIGRATION_STATE_CHANGE

Table '<tableId>': Illegal state transition from old commit type <lastCommitType> to new <commitType>.

UC_DELTA_MIGRATION_STATE_CHANGE_VERSION_MISMATCH

Table '<tableId>': versions do not match for state transition from old (<lastVersion>, <lastCommitType>) to new (<version>, <commitType>).

UC_DELTA_UNIVERSAL_FORMAT_CANNOT_PARSE_ICEBERG_VERSION

SQLSTATE: 22P02

Unable to parse Apache Iceberg table version from metadata location <metadataLocation>.

UC_DELTA_UNIVERSAL_FORMAT_COMMIT_VERSION_MISMATCH

The commit version <convertedDeltaVersion> in the Apache Iceberg metadata does not match catalog known version <commitVersion>.

UC_DELTA_UNIVERSAL_FORMAT_CONCURRENT_WRITE

A concurrent update to the same Apache Iceberg metadata version was detected.

UC_DELTA_UNIVERSAL_FORMAT_INVALID_METADATA_LOCATION

The committed metadata location <metadataLocation> is invalid. It is not a subdirectory of the table's root directory <tableRoot>.

UC_DELTA_UNIVERSAL_FORMAT_MISSING_FIELD_CONSTRAINT

The provided delta Apache Iceberg format conversion information is missing required fields.

UC_DELTA_UNIVERSAL_FORMAT_NON_CREATE_CONSTRAINT

Setting delta Apache Iceberg format information on create is unsupported.

UC_DELTA_UNIVERSAL_FORMAT_TOO_LARGE_CONSTRAINT

The provided delta Apache Iceberg format conversion information is too large.

UC_DELTA_UNIVERSAL_FORMAT_UPDATE_INVALID

Uniform metadata can only be updated on Delta tables with uniform enabled.

UC_DENY_POLICY_MULTIPLE_PRIVILEGES_NOT_SUPPORTED

Only one privilege is supported for DENY policies. Found <privilegeCount> privileges: <privileges>.

UC_DENY_POLICY_UNSUPPORTED_PRIVILEGE

Unsupported privileges for DENY policies: <unsupportedPrivileges>. Supported privileges: <supportedPrivileges>.

UC_DEPENDENCY_DEPTH_LIMIT_EXCEEDED

<resourceType> '<ref>' depth exceeds limit (or has a circular reference).

UC_DEPENDENCY_DOES_NOT_EXIST

<resourceType> '<ref>' is invalid because one of the underlying resources does not exist. <cause>

UC_DEPENDENCY_PERMISSION_DENIED

<resourceType> '<ref>' does not have sufficient privilege to execute because the owner of one of the underlying resources failed an authorization check. <cause>

UC_DUPLICATE_CONNECTION

A connection called '<connectionName>' with the same URL already exists. Please ask the owner for permission to use that connection instead of creating a duplicate.

UC_DUPLICATE_ONELAKE_CATALOG_CREATION

Attempted to create a OneLake catalog with url '<storageLocation>' that matches an existing catalog '<existingCatalogName>', which is not allowed.

UC_DUPLICATE_TAG_ASSIGNMENT_CREATION

Tag assignment with tag key <tagKey> already exists

UC_ENTITY_DOES_NOT_HAVE_CORRESPONDING_ONLINE_CLUSTER

Entity <securableType> <entityId> does not have a corresponding online cluster.

UC_ETAG_MISMATCH

Resource has been modified. Please fetch the latest etag and retry. Expected etag value: <expectedTokenValue> with protocol version <expectedTokenVersion>, received etag value: <providedTokenValue> with protocol version <providedTokenVersion>

UC_EXCEEDS_MAX_FILE_LIMIT

There are more than <maxFileResults> files. Please specify [max_results] to limit the number of files returned.

UC_EXTERNAL_HMS_SCHEMA_LOCATION_NOT_FEDERATED

Schema <schemaName> is in DEGRADED provisioning state which is expected since eHMS / Glue schema location is not being federated.

UC_EXTERNAL_LOCATION_OP_NOT_ALLOWED

Cannot <opName> <extLoc> <reason>. <suggestion>.

UC_EXTERNAL_SECRETS_CANNOT_BE_UPDATED

Updating external secrets is not supported.

UC_FEATURE_DISABLED

<featureName> is currently disabled in UC.

UC_FOREIGN_CATALOG_FOR_CONNECTION_TYPE_NOT_SUPPORTED

Creation of a foreign catalog for connection type '<connectionType>' is not supported. This connection type can only be used to create managed ingestion pipelines. Please reference Databricks documentation for more information.

UC_FOREIGN_CREDENTIAL_CHECK_ONLY_FOR_READ_OPERATIONS

Only READ credentials can be retrieved for foreign tables.

UC_FOREIGN_ENTITY_CREATION_FORBIDDEN_DURING_CONVERSION

Creating FOREIGN <securableType> '<entityName>' under catalog '<catalogName>' is forbidden while catalog is being converted from FOREIGN to STANDARD.

UC_FOREIGN_HMS_SHALLOW_CLONE_MISMATCH

The base table and clone table must be in the same catalog for shallow clones created in foreign Hive Metastore catalogs. Base table '<baseTableName>' is in catalog '<baseCatalogName>' and clone table '<cloneTableName>' is in catalog '<cloneCatalogName>'.

UC_FOREIGN_KEY_CHILD_COLUMN_LENGTH_MISMATCH

Foreign key <constraintName> child columns and parent columns are of different sizes.

UC_FOREIGN_KEY_COLUMN_MISMATCH

The foreign key parent columns do not match the referenced primary key child columns or any unique constraint columns. Foreign key parent columns are (<parentColumns>).

UC_FOREIGN_KEY_COLUMN_TYPE_MISMATCH

The foreign key child column type does not match the parent column type. Foreign key child column <childColumnName> has type <childColumnType> and parent column <parentColumnName> has type <parentColumnType>.

UC_GCP_INVALID_PRIVATE_KEY

Access denied. Cause: service account private key is invalid.

UC_GCP_INVALID_PRIVATE_KEY_JSON_FORMAT

Google Server Account OAuth Private Key has to be a valid JSON object with required fields, please make sure to provide the full JSON file generated from 'KEYS' section of service account details page.

UC_GCP_INVALID_PRIVATE_KEY_JSON_FORMAT_MISSING_FIELDS

UC_GRANT_POLICY_UNSUPPORTED_PRIVILEGE

Unsupported privileges for GRANT policies: <unsupportedPrivileges>. Supported privileges: <supportedPrivileges>.

UC_IAM_ROLE_NON_SELF_ASSUMING

The IAM role for this storage credential was found to be non self-assuming. Please check your role's trust and IAM policies to ensure that your IAM role can assume itself according to the Unity Catalog storage credential documentation.

UC_ICEBERG_COMMIT_CONFLICT

Cannot commit <tableName>: metadata location <baseMetadataLocation> has changed from <catalogMetadataLocation>.

UC_ICEBERG_COMMIT_INVALID_TABLE

Cannot perform Managed Apache Iceberg commit to a non Managed Apache Iceberg table: <tableName>.

UC_ICEBERG_COMMIT_MISSING_FIELD_CONSTRAINT

The provided Managed Apache Iceberg commit information is missing required fields.

UC_ICEBERG_METADATA_FILE_TOO_LARGE

Apache Iceberg metadata file for table <tableName> is too large (<fileSizeMB> MB, exceeds limit of <maxSizeMB> MB). This is likely caused by a large number of Apache Iceberg snapshots that have not been expired. Please consider expiring snapshots to reduce the metadata file size.

UC_ID_MISMATCH

The <type> <name> does not have ID <wrongId>. Please retry the operation.

UC_INFORMATION_SCHEMA_PER_METASTORE_DB_RATE_LIMIT_EXCEEDED

SQLSTATE: 53300

Too many information schema requests for the metastore. Please wait a moment and try again. If the issue persists, please consider adjusting the selectivity of your queries or reaching out to support for assistance.

UC_INTERNAL_UPDATE_METADATA_MODE_HEADER_NOT_ALLOWED

The X-Databricks-UC-Internal-Update-Metadata-Mode header can only be used by unity-catalog-ops service. Caller service: <callerService>.

UC_INVALID_ACCESS_BRICKSTORE_ONLINE_TABLE_DEPRECATION

Online table is deprecated. Acquiring access to online table <securableName> is no longer supported.

UC_INVALID_ACCESS_BRICKSTORE_PG_CONNECTION

Invalid access to database instance. <reason>

UC_INVALID_ACCESS_DBFS_ENTITY

Invalid access of <securableType> <securableName> in the federated catalog <catalogName>. <reason>

UC_INVALID_AZURE_BLOB_ENDPOINT

The provided Azure storage URL uses a blob endpoint (<uri>), but external locations require an ADLS Gen2 (DFS) endpoint. Use the format: abfss://CONTAINER@ACCOUNT.dfs.core.windows.net/PATH

UC_INVALID_AZURE_PATH

Invalid Azure path: <path>

UC_INVALID_CLOUDFLARE_ACCOUNT_ID

Invalid Cloudflare account ID.

UC_INVALID_CREDENTIAL_CLOUD

Invalid credential cloud provider '<cloud>'. Allowed cloud provider '<allowedCloud>'.

UC_INVALID_CREDENTIAL_PURPOSE_VALUE

Invalid value '<value>' for credential's 'purpose'. Allowed values '<allowedValues>'.

UC_INVALID_CREDENTIAL_TRANSITION

Cannot update a connection from <startingCredentialType> to <endingCredentialType>. The only valid transition is from a username/password based connection to an OAuth token based or PEM private key based connection.

UC_INVALID_CRON_STRING_FABRIC

SQLSTATE: 22P02

Invalid cron string. Found: '<cronString>' with parse exception: '<message>'

UC_INVALID_DIRECT_ACCESS_MANAGED_TABLE

Invalid direct access managed table <tableName>. Make sure source table & pipeline definition are not defined.

UC_INVALID_EMPTY_STORAGE_LOCATION

Unexpected empty storage location for <securableType> '<securableName>' in catalog '<catalogName>'. In order to fix this error, please run DESCRIBE SCHEMA <catalogName>.<securableName> and refresh this page.

UC_INVALID_MCP_POLICY_FUNCTION_NAME

Invalid MCP policy function name '<functionName>' for option '<option>'. Each value must be a fully-qualified UC function name in catalog.schema.function_name format.

UC_INVALID_OPTIONS_UPDATE

Invalid options provided for update. Invalid options: <invalidOptions>. Allowed options: <allowedOptions>.

UC_INVALID_OPTION_VALUE

Invalid value '<value>' for '<option>'. Allowed values '<allowedValues>'.

UC_INVALID_OPTION_VALUE_EMPTY

'<option>' cannot be empty. Please enter a non-empty value.

UC_INVALID_PAYLOAD_LOGGING_DESTINATION

Invalid payload_logging_destination '<value>'. Expected a three-part UC table name in the form catalog.schema.tablename_payload.

UC_INVALID_POLICY_CONDITION

SQLSTATE: 42611

Invalid condition in policy '<policyName>'. Compilation error with message '<message>'.

UC_INVALID_R2_ACCESS_KEY_ID

Invalid R2 access key ID.

UC_INVALID_R2_SECRET_ACCESS_KEY

Invalid R2 secret access key.

UC_INVALID_UPDATE_ON_SYSTEM_WORKSPACE_ADMIN_GROUP_OWNED_SECURABLE

Cannot update <securableType> '<securableName>' as it's owned by an internal group. Please contact Databricks support for additional details.

UC_INVALID_UPDATE_TABLE_DISASSOCIATE_FROM_PIPELINE

The table '<tableName>' belongs to an existing pipeline '<pipelineId>' and its pipeline_id field cannot be cleared.

UC_INVALID_WASBS_EXTERNAL_LOCATION_STORAGE_CREDENTIAL

Provided Storage Credential <storageCredentialName> is not associated with DBFS Root, creation of wasbs External Location is prohibited.

UC_LOCATION_INVALID_SCHEME

Storage location has invalid URI scheme: <scheme>.

UC_MALFORMED_OAUTH_SERVER_RESPONSE

The response from the token server was missing the field <missingField>. The returned server response is: <response>

UC_MANAGED_ICEBERG_UNSUPPORTED

Cannot support managed Apache Iceberg table on the current endpoint.

UC_MAPS_CONTINUATION_TOKEN_INVALID

The pagination token is invalid or has expired.

UC_MAPS_PAGINATION_FALLBACK_REQUIRED

The paginated request cannot continue. Discard partial results and retry without pagination.

UC_MAPS_SNAPSHOT_VERSION_CHANGED

The snapshot changed while the paginated request was in progress. Discard partial results and restart pagination.

UC_MATERIALIZED_METRIC_VIEW_OWNERSHIP_TRANSFER_NOT_SUPPORTED

Change owner on a materialized metric view '<tableName>' is not supported.

UC_MCP_POLICY_REQUIRES_CONNECTION_OWNER

MCP policy options can only be set by the connection owner. Connection '<connectionName>' is owned by a different user.

UC_MCP_POLICY_REQUIRES_MCP_CONNECTION

Option '<option>' can only be set when 'is_mcp_connection' is 'true'.

UC_METASTORE_ASSIGNMENT_STATUS_INVALID

'<metastoreAssignmentStatus>' cannot be assigned. Only MANUALLY_ASSIGNABLE and AUTO_ASSIGNMENT_ENABLED are supported.

UC_METASTORE_CERTIFICATION_NOT_ENABLED

Metastore certification is not enabled.

UC_METASTORE_HAS_ACTIVE_MANAGED_ONLINE_CATALOGS

The metastore <metastoreId> has <numberManagedOnlineCatalogs> managed online catalog(s). Please explicitly delete them, then retry the metastore deletion.

UC_METASTORE_QUOTA_EXCEEDED

This account with id <accountId> has reached the limit for metastores in region <region>.

UC_METASTORE_STORAGE_ROOT_CREDENTIAL_UPDATE_INVALID

Metastore root credential cannot be defined when updating the metastore root location. The credential will be fetched from the metastore parent external location.

UC_METASTORE_STORAGE_ROOT_DELETION_INVALID

Deletion of metastore storage root location failed. <reason>

UC_METASTORE_STORAGE_ROOT_READ_ONLY_INVALID

The root <securableType> for a metastore cannot be read-only.

UC_METASTORE_STORAGE_ROOT_UPDATE_INVALID

Metastore storage root cannot be updated once it is set.

UC_MISSING_SECURABLE_KIND_OPTION

<securableType>/<securableKind> must include the following option(s): <options>.

UC_MLFLOW_MODEL_CREDENTIAL_CLIENT_UPGRADE_REQUIRED

Cannot generate temporary '<opName>' credentials for model version <modelVersion>.

Please upgrade the mlflow package to version 2.18 or later and set the environment variable

MLFLOW_USE_DATABRICKS_SDK_MODEL_ARTIFACTS_REPO_FOR_UC=true on your compute.

UC_MODEL_INVALID_STATE

Cannot generate temporary '<opName>' credentials for model version <modelVersion> with status <modelVersionStatus>. '<opName>' credentials can only be generated for model versions with status <validStatus>

UC_NATIVE_USING_REF_OF_ABAC_MASKED_COLUMNS

Error evaluating ABAC policies on '<resource>'. Failed with message: Column '<usingCol>' has been masked by ABAC policy '<policyName>' and cannot be used as an input to native RLS/CM policies: <nativeFunctions>.

UC_NO_ORG_ID_IN_CONTEXT

Attempted to access org ID (or workspace ID), but context has none.

UC_ONELAKE_DATA_ITEM_NOT_FOUND

Fabric data item not found at Azure OneLake path '<path>'. Verify the workspace and item UUIDs and that the storage credential has access to them. Fabric error code: <fabricErrorCode>.

UC_ONELAKE_DATA_ITEM_NOT_UUID

Azure OneLake path '<path>': the data item component '<dataItem>' must be a valid UUID.

UC_ONELAKE_DISALLOWED_ITEM_TYPE

Azure OneLake path '<path>' references a data item of type '<actualType>'. External locations may only be created for items of type '<allowedType>'.

UC_ONELAKE_FABRIC_AUTH_FAILED

Storage credential does not have access to the Fabric workspace or data item at Azure OneLake path '<path>'. Fabric error code: <fabricErrorCode>.

UC_ONELAKE_INVALID_MANAGED_EL_URL

Azure OneLake path '<path>': the path must be inside the '/Files' folder of a Lakehouse data item.

UC_ONELAKE_PATH_BAD_DOMAIN

Azure OneLake path '<path>' must have the domain name '<expectedHost>'.

UC_ONELAKE_PATH_BAD_FORMAT

Azure OneLake path '<path>' must be of the format 'abfss://_WORKSPACEUUID@<host>/_DATAITEM_UUID/...'.

UC_ONELAKE_PATH_MISSING_AT

Azure OneLake path '<path>' does not contain '@'.

UC_ONELAKE_PATH_MISSING_WORKSPACE

Azure OneLake path '<path>' must contain a workspace name.

UC_ONELAKE_VOLUME_REQUIRES_LAKEHOUSE_ITEM

Cannot create a volume in a OneLake catalog because the specified OneLake item is not a Lakehouse.

UC_ONELAKE_WORKSPACE_NOT_UUID

Azure OneLake path '<path>': the workspace component '<workspace>' must be a valid UUID.

UC_ONLINE_CATALOG_NOT_MUTABLE

The <rpcName> request updates <fieldName>. Use the online store compute tab to modify anything other than comment, owner and isolationMode of an online catalog.

UC_ONLINE_CATALOG_QUOTA_EXCEEDED

Cannot create more than <quota> online stores in the metastore and there is already <currentCount>. You may not have access to any existing online stores. Contact your metastore admin to be granted access or for further instructions.

UC_ONLINE_INDEX_CATALOG_INVALID_CRUD

online index catalogs must be <action> via the /vector-search API.

UC_ONLINE_INDEX_CATALOG_NOT_MUTABLE

The <rpcName> request updates <fieldName>. Use the /vector-search API to modify anything other than comment, owner and isolationMode of an online index catalog.

UC_ONLINE_INDEX_CATALOG_QUOTA_EXCEEDED

Cannot create more than <quota> online index catalogs in the metastore and there is already <currentCount>. You may not have access to any existing online index catalogs. Contact your metastore admin to be granted access or for further instructions.

UC_ONLINE_INDEX_INVALID_CRUD

online indexes must be <action> via the /vector-search API.

UC_ONLINE_STORE_INVALID_CRUD

online stores must be <action> via the online store compute tab.

UC_ONLINE_TABLE_COLUMN_NAME_TOO_LONG

The source table column name <columnName> is too long. The maximum length is <maxLength> characters.

UC_ONLINE_TABLE_PRIMARY_KEY_COLUMN_NOT_IN_SOURCE_TABLE_PRIMARY_KEY_CONSTRAINT

SQLSTATE: 42P16

Column <columnName> cannot be used as a primary key column of the online table because it is not part of the existing PRIMARY KEY constraint of the source table. For details, please see <docLink>

UC_ONLINE_TABLE_TIMESERIES_KEY_NOT_IN_SOURCE_TABLE_PRIMARY_KEY_CONSTRAINT

SQLSTATE: 42P16

Column <columnName> cannot be used as a timeseries key of the online table because it is not a timeseries column of the existing PRIMARY KEY constraint of the source table. For details, please see <docLink>

UC_ONLINE_VIEWS_PER_SOURCE_TABLE_QUOTA_EXCEEDED

Cannot create more than <quota> online table(s) per source table.

UC_ONLINE_VIEW_ACCESS_DENIED

Accessing resource <resourceName> requires use of a Serverless SQL warehouse. Please ensure the warehouse being used to execute a query or view a database catalog in the UI is serverless. For details, please see <docLink>

UC_ONLINE_VIEW_CONTINUOUS_QUOTA_EXCEEDED

Cannot create more than <quota> continuous online views in the online store, and there is already <currentCount>. You may not have access to any existing online views. Contact your online store admin to be granted access or for further instructions.

UC_ONLINE_VIEW_DOES_NOT_SUPPORT_DMK

<tableKind> can not be created under storage location with Databricks Managed Keys. Please choose a different schema/catalog in a storage location without Databricks Managed Keys encryption.

UC_ONLINE_VIEW_INVALID_CATALOG

Invalid catalog <catalogName> with kind <catalogKind> to create <tableKind> within. <tableKind> can only be created under catalogs of kinds: <validCatalogKinds>.

UC_ONLINE_VIEW_INVALID_SCHEMA

Invalid schema <schemaName> with kind <schemaKind> to create <tableKind> within. <tableKind> can only be created under schemas of kinds: <validSchemaKinds>.

UC_ONLINE_VIEW_INVALID_TTL_TIME_COLUMN_TYPE

Column <columnName> of type <columnType> cannot be used as a TTL time column. Allowed types are <supportedTypes>.

UC_OPERATION_NOT_SUPPORTED

Operation not supported by Unity Catalog. <detailedMessage>

UC_OUT_OF_AUTHORIZED_PATHS_SCOPE

UC_OVERLAPPED_AUTHORIZED_PATHS

The 'authorized_paths' option contains overlapping paths: <overlappingPaths>. Ensure each path is unique and does not intersect with others in the list.

UC_PAGINATION_AND_QUERY_ARGS_MISMATCH

The query argument '<arg>' is set to '<received>' which is different to the value used in the first pagination call ('<expected>')

UC_PAGINATION_REQUIRED

The <rpcName> result set is too large to return in a single response. Please adopt the paginated version of this API by setting max_results and paging through results with page_token. Error code #UC-<errorCodeArbitraryFiveLettersUpperCase>

UC_PATH_FILTER_ALLOWLIST_VIOLATION

The credential '<credentialName>' is a workspace default credential that is only allowed to access data in the following paths: '<allowlist>'. Please ensure that any path accessed using this credential is under one of these paths.

UC_PATH_FILTER_DENYLIST_VIOLATION

The credential '<credentialName>' is a workspace default credential that cannot access data in the following restricted path: '<targetPath>'.

UC_PATH_TOO_LONG

The input path is too long. Allowed length: <maxLength>. Input length: <inputLength>. Input: <path>...

UC_PER_METASTORE_DATABASE_CONCURRENCY_LIMIT_EXCEEDED

Concurrency limit exceeded for metastore <metastoreId>. Please try again later. If the problem persists, please reach out to support. Error code #UC-<errorCodeArbitraryFiveLettersUpperCase>

UC_POLICY_TYPE_OPTIONS_MISMATCH

Policy options do not match the specified policy_type '<policyType>'. Expected '<expectedOptions>' options (required fields: <expectedRequiredFields>) but found '<actualOptions>' options.

UC_POSTGRESQL_ONLINE_VIEWS_PER_SOURCE_TABLE_QUOTA_EXCEEDED

Cannot create more than <quota> synced database table(s) per source table.

UC_PRIMARY_KEY_ON_NULLABLE_COLUMN

SQLSTATE: 42831

Cannot create the primary key <constraintName> because its child column(s) <childColumnNames> is nullable. Please change the column nullability and retry.

UC_REFERENTIAL_CONSTRAINT_DOES_NOT_EXIST

Table <tableName> does not have either a primary key constraint or a UNIQUE constraint.

UC_REQUEST_LIMIT_EXCEEDED

Your request was rejected since your organization has exceeded the rate limit. Please retry your request later.

UC_REQUEST_URL_NOT_RELATED_TO_TABLE

Request URL is not related to this <tableType> table. The request url = <requestUrl>. The table storage path is <tableStorageUrl>.<additionalLocationInfo>

UC_REQUEST_URL_REQUIRED_FOR_TABLE_TYPE

Request URL is required for table type <tableType>.

UC_RESOURCE_QUOTA_EXCEEDED

Cannot create <amount> <resourceType>(s) in <parentResourceType> <parentResourceId> (estimated count: <currentCount>, limit: <quotaLimit>).

UC_ROOT_STORAGE_S3_BUCKET_NAME_CONTAINS_DOT

Root storage S3 bucket name containing dots is not supported by Unity Catalog: <uri>

UC_SCHEMA_EMPTY_STORAGE_LOCATION

Unexpected empty storage location for schema '<schemaName>' in catalog '<catalogName>'. Please make sure the schema uses a path scheme of <validPathSchemesListStr>.

UC_SECRET_USED_BY_CONNECTIONS

Secret '<secretFullName>' cannot be deleted because it is used by <connectionCount> connection(s): <connectionNames>. Use the force option to delete anyway.

UC_SERVERLESS_UNTRUSTED_DOMAIN_STORAGE_TOKEN_MINTING

Serverless python and scala notebooks are prohibited from retrieving temporary storage credentials from Unity Catalog in network restricted workspaces.

UC_SHALLOW_CLONE_BASE_TABLE_DELETED

SQLSTATE: 42S02

Cannot access shallow clone '<tableFullName>' because its base table '<baseTableName>' has been deleted.

UC_STORAGE_CREDENTIALS_WITH_EXTERNAL_LOCATION_DELETION_DENIED

Storage credential '<credentialName>' has <extTablesCount> directly dependent external table(s) and <extLocationsCount> dependent storage location(s). You may use force option to delete it but the managed storage data using this storage credential cannot be purged by Unity Catalog anymore.

UC_STORAGE_CREDENTIALS_WITH_EXTERNAL_LOCATION_UPDATE_DENIED

Storage credential '<credentialName>' has <extTablesCount> directly dependent external table(s) and <extLocationsCount> dependent storage location(s); use force option to update anyway.

UC_STORAGE_CREDENTIAL_ACCESS_CONNECTOR_PARSING_FAILED

Failed to parse the provided access connector ID: <accessConnectorId>. Please verify its formatting and try again.

UC_STORAGE_CREDENTIAL_DBFS_ROOT_CREATION_PERMISSION_DENIED

Cannot create a storage credential for DBFS root because user: <userId> is not the admin of the workspace: <workspaceId>

UC_STORAGE_CREDENTIAL_DBFS_ROOT_PRIVATE_DBFS_ENABLED

DBFS root storage credential is not yet supported for workspaces with Firewall-enabled DBFS

UC_STORAGE_CREDENTIAL_DBFS_ROOT_PRIVATE_NOT_SUPPORTED

DBFS root storage credential for current workspace is not yet supported

UC_STORAGE_CREDENTIAL_DBFS_ROOT_WORKSPACE_DISABLED

DBFS root is not enabled for workspace <workspaceId>

UC_STORAGE_CREDENTIAL_FAILED_TO_OBTAIN_VALIDATION_TOKEN

Failed to obtain an AAD token to perform cloud permission validation on an access connector. Please retry the action.

UC_STORAGE_CREDENTIAL_GCP_DOMAIN_RESTRICTED_SHARING

Unable to grant the Databricks service account access to the workspace storage bucket because your Google Cloud organization's Domain Restricted Sharing policy (iam.allowedPolicyMemberDomains) does not permit it. Please ask your account admin to allow the Databricks service account's domain in the organization policy.

UC_STORAGE_CREDENTIAL_INVALID_CLOUD_PERMISSIONS

Registering a storage credential requires the contributor role over the corresponding access connector with ID <accessConnectorId>. Please contact your account admin.

UC_STORAGE_CREDENTIAL_METASTORE_ROOT_DELETION_DENIED

Storage credential '<credentialName>' cannot be deleted because it is configured as this metastore's root credential. Please update the metastore's root credential before attempting deletion.

UC_STORAGE_CREDENTIAL_PERMISSION_DENIED

Only the account admin can create or update a storage credential with type <storageCredentialType>.

UC_STORAGE_CREDENTIAL_SERVICE_PRINCIPAL_MISSING_VALIDATION_TOKEN

Missing validation token for service principal. Please provide a valid ARM-scoped Entra ID token in the 'X-Databricks-Azure-SP-Management-Token' request header and retry. For details, check https://docs.databricks.com/api/workspace/storagecredentials

FILES_API_API_IS_NOT_ENABLED

ABAC_POLICY_REQUIRES_USER_ACTION

This pipeline update could not apply an attribute-based access control (ABAC) policy on one or more tables.

To proceed, exclude the pipeline's run-as principal from any affected ABAC policies, then re-run the update.

ABNORMAL_DRIVER_TERMINATION

SQLSTATE: 57P02

Driver on cluster <clusterId> terminated abnormally due to <terminationCause>. Please check the driver logs for more details.

ACTIVE_UPDATE_EXISTS_FOR_LINKED_PIPELINE

An active update '<updateId>' already exists for linked pipeline '<linkedPipelineId>'.

ACTIVE_UPDATE_EXISTS_FOR_PIPELINE

An active update '<updateId>' already exists for pipeline '<pipelineId>'.

ADOBE_CAMPAIGNS_INVALID_INSTANCE_URL

The Adobe Campaigns connection option 'instance_url' is missing or is not a valid URL: '<instanceUrl>'.

Set 'instance_url' on the Unity Catalog connection to the Campaign instance base URL, for example 'https://<instance>.campaign.adobe.com'.

ALTER_NOT_ALLOWED_FOR_PIPELINE_TABLE

ALTER is not allowed on tables managed by a

For more details see ALTER_NOT_ALLOWED_FOR_PIPELINE_TABLE

ALTER_PERMISSION_DENIED

User does not have permission <action> on <tableName>.

ALTER_SCHEDULE_SCHEDULE_DOES_NOT_EXIST

Cannot alter <type> on a table without an existing schedule or trigger. Please add a schedule or trigger to the table before attempting to alter it.

AMBIGUOUS_PIPELINE_ENVIRONMENT_VERSION_PROVIDED

Mismatching client and environment version values provided. Please specify either client or environment version, but not both.

Specified client: <clientVersion>

Specified environment version: <environmentVersion>

API_QUOTA_EXCEEDED

An error occurred during the AUTO CDC operation.

For more details see APPLY_CHANGES_ERROR

APPLY_CHANGES_FROM_SNAPSHOT_ERROR

An error occurred during the AUTO CDC FROM SNAPSHOT operation.

For more details see APPLY_CHANGES_FROM_SNAPSHOT_ERROR

APPLY_CHANGES_FROM_SNAPSHOT_EXPECTATIONS_NOT_SUPPORTED

Dataset <datasetName> has expectations defined, but expectations are not currently supported for datasets using AUTO CDC FROM SNAPSHOT.

Remove the expectations to resolve this error. As an alternative, consider using the following structure to apply expectations by combining AUTO CDC and AUTO CDC FROM SNAPSHOT:

Apply changes from snapshot using SCD type 1 to an intermediate table without expectations.
Read changes from the intermediate table using spark.readStream.option("readChangeFeed", "true").table.
Apply changes from the intermediate table to the final target table using dlt.apply_changes with the following parameters in addition to those currently used with dlt.apply_changes_from_snapshot:

To handle changes: apply_as_deletes = "_change_type == 'delete'"
To remove columns added by the CDF: except_column_list = ["_change_type", "_commit_version", "_commit_timestamp"]

Include the current set of expectations on the final target table used for dlt.apply_changes.

APPLY_CHANGES_PARTIAL_UPDATES_NOT_ENABLED

Feature COLUMNS TO UPDATE is not enabled for your workspace.

APPLY_CHANGES_SEQUENCE_BY_TYPE_CHANGED

The SEQUENCE BY column type for table <tableName> has changed from <existingType> to <newType>. Changing the SEQUENCE BY column type is not allowed without a full refresh. Please restart the pipeline with full refresh.

APPLY_CHANGES_SYSTEM_SEQUENCING_REQUIRES_BITEMPORAL

system_sequence_by is only supported when stored_as_scd_type is "bitemporal".

Set stored_as_scd_type="bitemporal" to create a bitemporal table, or remove

system_sequence_by.

APPLY_ENVIRONMENT_CLUSTER_NOT_AVAILABLE

Pipeline compute for <pipelineId> is not available. The pipeline compute may have stopped or may still be starting up.

Please try again later when the compute is fully available. If the problem persists, please contact Databricks support.

APPLY_ENVIRONMENT_CLUSTER_NOT_FOUND

For more details see AUTO_MIGRATION_ENVIRONMENT_VERSION_ENABLEMENT_BLOCKED

AUTO_ROUTER_DOWNSTREAM_SCHEMA_MISMATCH

The flow '<flowName>' reading from auto router '<routerName>' writes to '<destination>', whose declared schema does not match the flow's output schema.

Remove the explicit schema from the destination so it is inferred from the flow, or make the declared schema match the flow's output.

AUTO_ROUTER_INCONSISTENT_INPUT_SCHEMAS

The flow '<flowName>' writing into auto router '<routerName>' has a schema that does not match the router's other input flows.

All flows writing into an auto router must produce the same columns and types.

AUTO_ROUTER_MULTIPLE_STREAMING_SOURCES

The flow '<flowName>' reading from auto router '<routerName>' reads more than one streaming source, which is not supported by the SYNCHRONIZED auto router policy.

A flow reading from an auto router must read only that one router (do not union it with another stream or read multiple routers).

AUTO_ROUTER_NOT_ENABLED

The create_auto_router() API is not enabled for this workspace. Contact your Databricks representative to enable this preview.

AUTO_ROUTER_STATEFUL_DOWNSTREAM

The flow '<flowName>' reading from auto router '<routerName>' contains a cross-batch stateful streaming aggregate, which is not supported by the SYNCHRONIZED auto router policy.

Move the aggregate to a separate streaming table downstream of the router's destination, or remove it from the flow reading the router.

AUTO_ROUTER_UNSUPPORTED_DOWNSTREAM

The flow '<flowName>' reading from auto router '<routerName>' writes to '<destination>' (<destinationType>), which is not a supported auto router destination.

Auto router downstreams must be streaming tables or Delta sinks.

AUTO_ROUTER_UNSUPPORTED_INPUT

The flow '<flowName>' writing into auto router '<routerName>' is not an append (streaming) flow, which is the only input type supported by the SYNCHRONIZED auto router policy.

Auto router inputs must be streaming append flows.

AUTO_TTL_INVALID_EXPIRE_IN_DAYS

Invalid value for expireInDays: <expireInDays>.

Must be a non-negative integer (>= 0).

Requested AWS S3 bucket does not exist. Please contact your account admin to resolve the issue.

AWS_S3_OBJECT_LOCK_NOT_SUPPORTED

The AWS S3 bucket '<bucket>' used by this pipeline has Object Lock enabled, which is not supported.

Please disable Object Lock on this bucket.

AWS_STORAGE_ACCESS_BLOCKED

An AWS storage request was not authorized.

Validate your AWS storage credentials or firewall exception settings.

AZURE_ACTIVE_DIRECTORY_APPLICATION_DISABLED

Unable to sign in to the application.

The service principal is disabled on the resource tenant.

Contact the tenant owners to determine why it was disabled and re-enable it if appropriate.

AZURE_ACTIVE_DIRECTORY_AUTHENTICATION_FAILED

Failed to get credentials: Storage Credential is not configured correctly. Please contact your account admin to update the configuration.

AZURE_STORAGE_HOSTNAME_RESOLUTION_FAILED

Failed to resolve Azure storage hostname: <hostname>.

Check that DNS is properly configured and the storage account is accessible from your network.

AZURE_STORAGE_INVALID_CONFIGURATION

Failed to initialize configuration for storage account <storageAccount>.

Invalid configuration value detected for <configKey>.

Check that the storage account is configured correctly.

AZURE_STORAGE_REQUEST_NOT_AUTHORIZED

The request to Azure storage was not authorized by network security perimeter.

Verify that the storage is correctly configured and accessible.

BIGQUERY_DATA_CONNECTOR_SOURCE_CATALOG_MISSING

An error occurred in the BigQuery data connector.

The 'source catalog' (GCP Project ID) is missing in your ingestion specification.

Please specify the source catalog (project ID) in your ingestion specification to resolve this issue.

BUDGET_POLICY_CHECK_UNAVAILABLE

An internal error occurred while starting the pipeline update.

Please retry the update. If the problem persists, contact your Databricks administrator.

BUDGET_POLICY_DENIED

The pipeline's budget policy does not allow this operation. Please contact your billing administrator.

BYOK_WORKSPACE_MISCONFIGURED

Cannot start the update because the workspace's customer-managed key (BYOK) is misconfigured. Please contact your workspace administrator to fix the BYOK configuration.

CANCEL_NOT_SUPPORTED_FOR_DP_INITIATED_UPDATE

Cannot cancel update '<updateId>' on pipeline '<pipelineId>' from the control plane.

This update was initiated from some other parent workload (<cause>), and can only be canceled by interrupting the originating command.

CANNOT_ADD_COLUMN_TO_INCLUDE_COLUMNS

New columns (<columnNames>) are added to include_columns field in pipeline definition for the table <qualifiedTableName>. Please full refresh the table to avoid potential data loss or remove these columns from include_columns.

CANNOT_ADD_STORAGE_LOCATION

Cannot add storage location to an existing pipeline with defined catalog, if you want to set a storage location create a new pipeline.

Existing catalog: '<catalog>'.

Requested storage location: <storageLocation>.

CANNOT_ADD_TABLES_AFTER_SCHEMA_LOCATION_CHANGE

Cannot add new tables to pipeline because the target schema's storage location has changed.

Schema '<schemaName>' now has storage location: <newStorageLocation>

New tables that cannot be created: <newTableNames>

Options to resolve:

Remove the new table definitions from your pipeline

For more details see CANNOT_ADD_TABLES_AFTER_SCHEMA_LOCATION_CHANGE

CANNOT_CHANGE_DATASET_TYPE

Cannot change the dataset type of a pipeline table from <existingType> to <newType> for <identifier>.

To change the dataset type, please drop the existing dataset first.

CANNOT_CHANGE_TABLE_MODEL_TYPE

Cannot redefine <identifier> because it would change the existing table's type.

A managed table (created via the create_table() API or CREATE TABLE name FLOW ...) and a streaming table or materialized view cannot take over each other's name.

To reuse this name with a different table type, please drop the existing table first.

CANNOT_COMPOSE_DECORATOR

The @<decoratorName> decorator cannot be composed with <otherDecorators>.

CANNOT_DELETE_DATASET_FOR_NON_UC_PIPELINE

Cannot set the cascade parameter to true for HMS pipelines. Spark Declarative Pipelines on Lakeflow service cannot cascade delete HMS tables

on pipeline deletion. Please set the cascade parameter to false or omit to delete pipeline '<pipelineId>'.

CANNOT_DELETE_PIPELINE_CLEANUP_FAILED

Cannot delete pipeline '<pipelineId>': failed to cleanup resources on cluster '<clusterId>'.

Use the 'force' parameter to delete the pipeline without resource cleanup.

CANNOT_DELETE_PIPELINE_CLUSTER_UNAVAILABLE

Cannot delete pipeline '<pipelineId>': cluster '<clusterId>' is unavailable for resource cleanup.

Use the 'force' parameter to delete the pipeline without resource cleanup.

CANNOT_DELETE_PIPELINE_NO_ACTIVE_CLUSTER

Cannot delete pipeline '<pipelineId>': no active cluster found to cleanup resources.

Use the 'force' parameter to delete the pipeline without resource cleanup.

CANNOT_EXCLUDE_NON_EXISTENT_COLUMN

Pipeline definition excludes columns (<columnNames>) that do not exist in the table <qualifiedTableName> of source <sourceType>. Please remove these columns from the exclude_columns field.

CANNOT_FILTER_OUT_REQUIRED_COLUMN

Pipeline definition does not include required columns (<columnNames>) in the table <qualifiedTableName> of source <sourceType> for ingestion. Please add them to include_columns or remove them from exclude_columns.

CANNOT_INCLUDE_NON_EXISTENT_COLUMN

Pipeline definition includes columns (<columnNames>) that do not exist or are not accessible in the table <qualifiedTableName> of source <sourceType>. Please remove these columns from the include_columns field.

CANNOT_INGEST_TABLE_WITHOUT_PRIMARY_KEY

The table <qualifiedTableName> in the <sourceType> source doesn't have a primary key.

Please specify a primary key in connector configuration to ingest the table if it exists.

CANNOT_MODIFY_PIPELINE_OWNER_FOR_UC_PIPELINES

Changing owner for non-UC pipelines is not supported yet.

CANNOT_MODIFY_PIPELINE_OWNER_PERMISSION_DENIED

Columns (<columnNames>) are removed from exclude_columns field in pipeline definition for the table <qualifiedTableName>. Please full refresh the table to avoid potential data loss or add these columns back to exclude_columns.

CANNOT_REMOVE_COLUMN_MAPPING_MODE

Cannot remove column mapping mode '<existingColumnMappingMode>' for table '<tableName>'.

To remove column mapping, trigger a full refresh of the table along with the removal of the column mapping mode configuration.

Alternatively, restore the column mapping mode configuration in your table definition.

CANNOT_REMOVE_PIPELINE_ENVIRONMENT_VERSION

Environment version cannot be removed from a pipeline once set.

Current environment_version: <currentEnvironmentVersion>.

To change it, specify a different environment version in the pipeline spec; to keep the existing behavior, leave the field as <currentEnvironmentVersion>.

CANNOT_SET_CATALOG_FOR_HMS_PIPELINE

Cannot add catalog to an existing pipeline with defined storage location, if you want to use UC create a new pipeline and set catalog.

Existing storage location: '<storageLocation>'

Requested catalog: '<catalog>'

Depending on your use case and the schema changes, you may be able to obviate the schema change -- you can update your queries so the output schema is compatible with the existing schema (e.g, by explicitly casting columns to the correct data type).

CANNOT_WRITE_TO_INACTIVE_COLUMNS

<details>

However, the destination table(s) already has inactive column(s) with this name; the columns are inactive because they were previously deleted from the source tables.

To proceed with the update, run a FULL REFRESH on the tables.

CANNOT_WRITE_TO_INACTIVE_TABLES

The following tables in the destination are inactive and conflict with the current source tables: <tables>.

These tables remain inactive because they were previously deleted from the source or unselected from the connector.

To proceed with the update, please change the destination table name or perform a FULL REFRESH on these tables or drop these inactive tables from the destination in Catalog Explorer or via DROP TABLE command, and retry the update.

CANNOT_WRITE_TO_TABLES_PENDING_RESET

The following tables in the destination are not reset correctly in the previous full refresh: <tables>.

Please trigger a full refresh on them to recover.

CATALOG_MAPPING_NOT_AVAILABLE_IN_UC

SQLSTATE: 3D000

UC catalog doesn't have the mapping for the catalog '<sourceCatalog>'.

Please check if catalog is registered in the UC catalog.

CATALOG_SCHEMA_MISMATCH_WITH_DESTINATION_PIPELINE

The catalog <destPipelineCatalog> and schema <destPipelineSchema> of the destination pipeline with ID '<destPipelineId>' do not match the catalog and schema of the table <tableName>. The destination pipeline should have the same catalog and schema as the table or the destination pipeline must be using the Direct Publishing Mode.

CATALOG_SPEC_UNSUPPORTED

CatalogSpecs are not supported by the database connectors currently. Please remove the catalog spec.

CATALOG_TABLE_ID_CANNOT_BE_MODIFIED

The table property '<key>' is managed by the system and cannot be set or modified by users.

CDC_APPLIER_AUTO_FULL_REFRESH_POLICY_MUST_BE_SAME_FOR_ALL_DESTINATION_TABLES

Auto Full Refresh Policy of all destination tables connected to the same source table must be same.

Change the policy for following destination tables <destinationTables> connected to source <sourceTable>.

CDC_APPLIER_COLUMN_UOID_NOT_SUPPORTED

Columns with UOID <columnNames> for table <tableName> are not supported in CDC managed ingestion pipelines.

Please check if the ingestion pipeline supports column UOID, or request a full refresh on the table.

CDC_APPLIER_FATAL_FAILURE_FROM_GATEWAY

The Gateway Pipeline encountered a fatal error:

<errorMessage>

Review the pipeline update failure here: <link>.

CDC_APPLIER_INGESTION_GATEWAY_REMOVED

The ingestion gateway pipeline <pipelineId> linked to the Managed Ingestion Pipeline has been removed.

Please remove the Managed Ingestion pipeline, and create both Ingestion Gateway and Managed Ingestion pipelines.

CDC_APPLIER_INVALID_REFRESH_SELECTION

The <refreshMode> parameters specified for this update are invalid. The following tables <tablesNotFound> are not part of this pipeline.

CDC_APPLIER_REPLICATED_TABLE_METADATA_NOT_READY

Replicated table metadata for table <tableName> is not ready.

The existing job request timestamp is <existingRequestTs>, but we expect <expectedRequestTs> or later.

CDC_APPLIER_REQUIRES_ALL_DESTINATION_TABLES_FULL_REFRESH

Full refresh of one destination table and normal update of another destination table from the same source is not supported.

Please full refresh both tables to continue if possible.

Full refresh tables: <fullRefreshTables>

Destination tables for source <sourceTable>: <destinationTables>

CDC_APPLIER_RESETTING_STAGING_TABLE_NOT_ALLOWED

Selective full refresh of the staging table is not supported. A full pipeline refresh is required to refresh the staging table.

CDC_APPLIER_SCHEMA_CHANGED_DURING_STREAMING

Schema version <dataSchemaVersion> is different from read schema version <readSchemaVersion>.

The pipeline will retry the update.

CDC_APPLIER_SEQUENCE_BY_COLUMN_NOT_FOUND

The column <columnName> for table <tableName> specified in sequenceBy does not exist in <columns>.

CDC_APPLIER_SEQUENCE_BY_INVALID_TYPE

The column <columnName> for table <tableName> specified in sequenceBy is of type <typeName> that is not supported.

Supported types for sequenceBy columns are <allowedTypes>.

CDC_APPLIER_SEQUENCE_BY_MULTIPLE_COLUMNS_NOT_SUPPORTED

At most one column can be specified in sequenceBy of CDC managed ingestion pipeline.

Specified columns: <columns> for table <tableName>.

CDC_APPLIER_SOURCE_TABLE_ALREADY_REGISTERED_IN_GATEWAY

Source table <sourceTable> is already being ingested by another Managed Ingestion pipeline <otherPipelineId> through the same Ingestion Gateway.

Each source table can only be ingested by one Managed Ingestion pipeline per Ingestion Gateway.

Remove the conflicting table from one of the pipelines to resolve this conflict.

CDC_APPLIER_UNSUPPORTED_CHARACTERS_IN_DESTINATION_TABLE_NAME

The destination <objectType> name <name> is not valid: <validationErrors>.

Provide a different destination name in the Ingestion config object.

CDC_APPLIER_UNSUPPORTED_SOURCE_OPTION_FOR_CDC_CONNECTOR

Unsupported source_type : <sourceType> and connector_type : <connectorType> in ingestion_definition for Cdc Connector.

CDC_INCOMPATIBLE_SCHEMA_CHANGES

We encountered an incompatible schema change from schema version <previousSchemaVersion> to <currentSchemaVersion>.

Therefore we cannot proceed on applying changes for <tableName>. Please request a full refresh of the table.

Previous schema: <previousSchema>

Current schema: <currentSchema>

For more details see CDC_INCOMPATIBLE_SCHEMA_CHANGES

CDC_MULTIPLE_SOURCE_TABLES_MAPPED_TO_SAME_DESTINATION_TABLE

Found multiple source tables: <source_tables> mapped to same destination table <destination_table>.

Please map them to different destination table name or to different destination schema.

CDC_POTENTIAL_DATA_GAPS

Following tables [<needFullRefreshTableList>] does not have a successful update for <retention> days.

Please do a full refresh on these tables or the whole pipeline.

Realtime applier driver is under-provisioned for <numCdcFlows> CDC flows.

CDC_REALTIME_APPLIER_GRAPH_REANALYSIS

Graph re-analysis required. Flows to add: [<flowsToAdd>]. Flows to delete: [<flowsToDelete>].

CDC_REALTIME_APPLIER_NEW_TABLE_DETECTED

New tables detected in source which are part of the configuration: <tableNames>.

Restarting the pipeline to replicate the new tables.

CDC_SAME_TABLE_FROM_MULTIPLE_SOURCES

Found the same table name <table> from multiple sources: <sources>.

Please split them into different pipelines to avoid conflict.

CDC_SOURCE_VALIDATION_FAILURE

Source database validation detected <errorCount> error(s). See the event log report(s) for detailed results and remediation steps.

CDC_TABLE_NOT_FOUND_IN_ALL_TABLES

Cannot use CLUSTER BY or CLUSTER BY AUTO on table <tableName>: the table is currently partitioned by <partitionColumns>, and partition columns cannot be removed without a full refresh.

CLUSTER_CREATION_BUDGET_POLICY_LIMIT_EXCEEDED

Failed to create a cluster because the pipeline's budget policy has exceeded the limit. Please use a different policy or reach out to your billing admin.

CLUSTER_CREATION_CLIENT_ERROR

Failed to create a pipeline cluster: <errorMessage>

This error is likely due to a misconfiguration in the pipeline.

Check the pipeline cluster configuration and associated cluster policy.

CLUSTER_CREATION_CLUSTER_POLICY_LIMIT_EXCEEDED

Failed to create a cluster because the number of running clusters per user for policy "<clusterPolicy>" has exceeded the limit of <clusterLimit>. Please use a different policy or reach out to your admin.

CLUSTER_CREATION_CREDITS_EXHAUSTED

Failed to create a cluster because you've exhausted your available credits. Please add a payment method to upgrade your account.

CLUSTER_CREATION_RESOURCE_EXHAUSTED

Failed to create a cluster because you've exceeded resource limits: <errorMessage>

CLUSTER_CREATION_SECRETS_FETCH_FAILED

Cannot fetch secrets referred in the Spark configuration.

Please check that the secrets exists and the cluster's owner has read permissions.

CLUSTER_LAUNCH_CLIENT_ERROR

Failed to launch pipeline cluster <clusterId>: <clusterStateMessage>

This error is likely due to a misconfiguration in the pipeline.

Check the pipeline cluster configuration and associated cluster policy.

CLUSTER_LAUNCH_CLOUD_FAILURE

Failed to launch pipeline cluster <clusterId>: <clusterStateMessage>

This error could be transient - restart your pipeline and report if you still see the same issue.

CLUSTER_LAUNCH_COST_CONTROL_ENTITLEMENT_DENIED

Failed to launch pipeline cluster <clusterId>: <clusterStateMessage>

The pipeline's serverless compute or usage policy cannot be applied.

Verify the serverless_compute_id and usage_policy_id configured on the pipeline, and that the run-as identity is entitled to use them.

CLUSTER_LAUNCH_RESOURCE_EXHAUSTED

Failed to launch pipeline cluster <clusterId> due to exhausting resource limits: <clusterStateMessage>.

CLUSTER_LAUNCH_RESOURCE_STOCKOUT

Failed to launch pipeline cluster <clusterId>: <clusterStateMessage>

The instance type requested could not be supplied by the cloud provider.

Please check your cloud provider subscription or try again with a different instance type.

CLUSTER_SETUP_CLIENT_ERROR

Unable to successfully setup cluster <clusterId> for pipeline update execution. Reason:

For more details see CLUSTER_SETUP_CLIENT_ERROR

CLUSTER_UNREACHABLE

Communication lost with driver. Cluster <clusterId> was not reachable for <timeoutSeconds> seconds.

COLUMN_MASK_WITH_NO_COLUMN

Column mask found for column '<columnName>' which doesn't exist in MV/ST schema. If this is because of a change to the base table's schema,

please drop the old mask with ALTER TABLE [table_name] ALTER COLUMN [column where mask is applied] DROP MASK; or restore the column.

COLUMN_TO_UPDATE_NOT_FOUND

Column <column> specified in COLUMNS TO UPDATE not found in source Dataframe.

CONCURRENT_UPGRADE_FAILED_TO_STOP_PREVIOUS_UPDATE

Started update '<upgradedUpdateId>' for an upgrade but failed to stop the previous update '<oldUpdateId>'.

Offending table: '<table>'.

To fix this, use the STREAM() or readStream operator to declare the source as a streaming input.

Example: SELECT ... FROM STREAM(<source table name>) or spark.readStream.table('<source table name>')

CREATE_STREAMING_TABLE_WITH_FLOW_DISABLED

The CREATE STREAMING TABLE ... FLOW syntax is currently disabled for table '<tableName>'.

DATABASE_TABLE_SYNC_EDIT_RESTRICTED

DatabaseSyncTable Pipeline <pipelineId>: only updates to sinks, name, tags, notifications, budgetPolicyId and dbrVersion are allowed.

DATASET_DECORATOR_APPLIED_TWICE

Dataset <datasetName> already exists. Ensure that the query function has only been marked as a view or table once.

DATASET_DELETION_CANNOT_BE_DISABLED_UNSUPPORTED_PIPELINE_TYPE

Cannot set the cascade parameter to false when deleting pipeline '<pipelineId>' of type '<pipelineType>'.

Please set the cascade parameter to true or omit it to delete the pipeline.

DATASET_DELETION_REQUIRES_DPM

Cannot set the cascade parameter to false when deleting legacy publishing mode pipeline '<pipelineId>'.

Please migrate the pipeline to default publishing mode if you wish to skip deletion of

pipeline tables.

DATASET_NOT_DEFINED

DELTA_LOG_ADD_FILE_MISSING

Cannot read <sourceName> table at '<tablePath>': version <version> references ADD paths that no longer exist on storage.

Missing paths: <missingPaths>.

This typically means the upstream export VACUUM'd or compacted files that this commit still references. Run full refresh on the pipeline after a new checkpoint is made.

DELTA_LOG_NO_VALID_CHECKPOINT

Cannot bootstrap streaming for <sourceName> table at '<tablePath>': <reason>.

The source has not produced a usable checkpoint to seed the live state. Verify the upstream export is healthy and that a new checkpoint has been published, then run the pipeline

DELTA_LOG_VERSION_FILES_COMPACTED

Cannot resume streaming for <sourceName> table at '<tablePath>': the streaming offset is at version <fromVersion>, but the earliest available .json commit is <minAvailable>.

Pipeline cannot be started because it uses the deprecated Custom Schema private preview (the settings: <settings> are enabled).

Please create a new pipeline with default publishing mode, using the 'schema' field,

in the pipeline specification, and move the datasets from this pipeline to the new pipeline.

DEPRECATED_RELEASE_CHANNEL_NOT_ALLOWED

The pipeline release channel cannot be set to '<channel>' because it is deprecated.

Expected one of [<allowedChannels>].

DESTINATION_PIPELINE_NOT_FOUND

The destination pipeline with ID '<pipelineId>' can not be found. Make sure you are in the same workspace as the pipeline, you are the owner of the pipeline, and the pipeline ran at least once.

DESTINATION_PIPELINE_NOT_IN_DIRECT_PUBLISHING_MODE

SQLSTATE: 0AKLT

The destination pipeline with ID '<pipelineId>' is not using the Direct Publishing Mode.

DESTINATION_PIPELINE_PERMISSION_DENIED

You are not allowed to perform this operation, you are not the owner of the destination pipeline with ID '<pipelineId>'. Only owners can change the pipeline of a table.

DESTINATION_PIPELINE_TYPE_NOT_WORKSPACE_PIPELINE_TYPE

SQLSTATE: 0AKLT

The destination pipeline with ID '<pipelineId>' is not an ETL pipeline.

DIRECTORY_PATH_REQUIRES_GLOB

The path <path> is a directory. To include all files within a directory, use the glob pattern with '**' suffix , '<path>/**', in your pipeline configuration.

DIRECT_CDC_ALL_SOURCE_TABLES_FATALLY_FAILED

All source tables have encountered fatal errors. The extractor cannot make further progress and has been stopped early.

DIRECT_CDC_EXTRACTOR_PARTIAL_EXECUTION_CLIENT_ERROR

Extraction failed for following source tables (<tables>) due to non-retryable errors.

<flowErrors>

Check the event log and fix the issues accordingly.

DIRECT_CDC_INVALID_CONNECTION_CONFIGURATION

DUPLICATED_FROM_JSON_SCHEMA_LOCATION

Duplicated from_json schema location key: <schemaLocationKey>.

Please pick unique schema location keys for each from_json query in the pipeline

DUPLICATED_INGESTION_CONFIG_TABLE_SPECS

Ingestion pipeline configuration contains duplicate tables. Please ensure that each table is unique.

EDIT_METRIC_VIEW_ON_PATCH_DISABLED

EVENT_LOG_PICKER_FEATURE_NOT_SUPPORTED

Publishing the event log to Unity Catalog is not supported in legacy publishing mode. To enable this feature, migrate your pipeline to default publishing mode by following the steps in the migration guide https://docs.databricks.com/aws/en/dlt/migrate-to-dpm. If you prefer to continue using legacy publishing mode, remove the 'event_log' configuration from your pipeline specification.

EVENT_LOG_TABLE_DELTA_TRUNCATED_TRANSACTION_LOG

The Delta transaction log for the Event Log table is missing recent history.

This can occur if the table was manually modified or if old log files were removed due to retention settings.

To resolve this issue, restore the event log table to an earlier version or drop the table.

EXPECTATIONS_NOT_SUPPORTED_ON_VIEW

Expectations are not supported on views. View '<viewName>' has expectations defined.

Use CREATE TEMPORARY VIEW instead, or remove the expectations.

EXPECTATION_VIOLATION

FLOW_SCHEMA_CHANGED

Flow <flowName> has terminated since it encountered a schema change during execution.

The schema change is compatible with existing target schema and the next run of the flow can resume with the new schema.

FOREACH_BATCH_SINK_ONLY_SUPPORTED_IN_PREVIEW_CHANNEL

Pipeline ForeachBatch Sink is not currently supported.

The private preview for pipeline ForeachBatch sink requires the PREVIEW channel.

Pipeline sinks: <sinkNames>

GATEWAY_PIPELINE_INIT_SCRIPTS_NOT_ALLOWED

The Gateway pipeline does not allow cluster init scripts. Please remove it from <from>.

GATEWAY_PIPELINE_SPARK_CONF_NOT_ALLOWED

The Gateway pipeline does not allow spark config [<configs>]. Please remove them from <from>.

GCP_STORAGE_ACCESS_BLOCKED

A Google Cloud Storage request was not authorized.

Validate your GCS storage credentials or IAM permission settings.

GDRIVE_CONNECTOR_CONSUMER_ACCOUNT_NOT_SUPPORTED

The authenticated account belongs to a consumer domain (<domain>). <sourceName> requires a Google Workspace account

for listing user and group information.

The GitHub API request failed for table <table>.

If the error persists, file a ticket.

GITHUB_API_SERVER_ERROR

The GitHub API returned a server error (HTTP <httpStatus>) for table <table> after retries and query-size reduction were exhausted.

This typically indicates a server-side problem at GitHub. If the error persists, file a ticket.

GITHUB_AUDIT_LOG_ACCESS_DENIED

Access to the audit log for GitHub organization <organization> was denied (the GitHub API returned HTTP 404).

The audit log REST API is only available for organizations on GitHub Enterprise Cloud, and only to tokens that belong to an organization owner.

Verify that (1) the organization is on GitHub Enterprise Cloud, (2) the OAuth token or personal access token belongs to an organization owner, and (3) the token has the read:audit_log scope.

If the error persists, file a ticket.

GITHUB_NO_ORGS_FOUND

No GitHub organizations are accessible to the configured token. The GitHub connector ingests data from repositories that belong to organizations, so at least one organization must be accessible.

Verify that (1) the OAuth token or personal access token has the read:org scope, and (2) the authenticated user is a member of at least one GitHub organization that owns the repositories you want to ingest.

If the error persists, file a ticket.

GITHUB_RATE_LIMIT_EXCEEDED

The GitHub API call failed due to rate limits after exhausting all retries. Operation: <operationType>.

GitHub enforces 5,000 requests/hour per OAuth user (15,000/hour on GitHub Enterprise Cloud) for the REST API and a separate 5,000 points/hour budget for the GraphQL API.

To resolve this, you can: (1) split the tables into separate pipelines and schedule them to run at different times to spread the load, (2) reduce the number of repositories ingested by applying a row_filter on repository_id, or (3) upgrade to GitHub Enterprise Cloud for a higher rate limit budget.

If the error persists, file a ticket.

GITHUB_RESOURCE_NOT_FOUND

The GitHub API returned HTTP 404 Not Found for the request to <url>.

The requested resource does not exist, or the configured token does not have access to it. Verify that the organization, repository, or resource still exists and that the token has the scopes and permissions required to read it.

If the error persists, file a ticket.

GOOGLE_ANALYTICS_RAW_DATA_CONNECTOR_SOURCE_CATALOG_MISSING

An error occurred in Google Analytics raw data connector.

Pipeline previously ran with environment version <environmentVersion>, which is no longer compatible with DBR <dbrVersion>.

To continue, set an explicit environment version (for example, <suggestedMaximumEnvironmentVersion> or older) in your pipeline spec.

INCOMPATIBLE_PIPELINE_ENVIRONMENT_VERSION_PROVIDED

Incompatible environment version <environmentVersion> selected for pipeline running DBR <dbrVersion>.

Consider selecting environment version <suggestedMaximumEnvironmentVersion> or older.

INCORRECT_ROOT_PATH_TYPE

Root path '<rootPath>' must be a directory but found <objectType>.

INCREMENTAL_DRY_RUN_REQUIRES_SQL

This validate-only update uses the incremental analysis engine, which currently supports only pipelines defined entirely in SQL.

Your pipeline includes Python or other non-SQL definitions. Define all datasets in SQL, or turn off the incremental dry-run setting (pipelines.useIncrementalDryRunEngineForSqlPipelines) for this pipeline.

INCREMENTAL_REFRESH_UNAVAILABLE_WITH_STRICT_REFRESH_POLICY

materialized view has a refresh policy of INCREMENTAL_STRICT but cannot be incrementalized.

INFRASTRUCTURE_MAINTENANCE

SQLSTATE: 57P01

Driver on cluster <clusterId> terminated due to infrastructure maintenance.

INGESTION_CONFIG_DUPLICATED_SCHEMA

Ingestion pipeline configuration contains duplicate schemas. Please ensure that each schema is unique.

INGESTION_GATEWAY_AUTHENTICATION_FAILURE

Authentication failure

For more details see INGESTION_GATEWAY_AUTHENTICATION_FAILURE

INGESTION_GATEWAY_AUTOMATIC_DDL_HANDLING_NOT_SUPPORTED

CDC Connector encountered a DDL operation on table '<entityName>'. Automatic capturing of DDL/schema changes is not supported. Perform a full refresh on this table to capture the schema changes.

Error message: <errorMessage>

INGESTION_GATEWAY_BREAKING_SCHEMA_CHANGE_FAILURE

An incompatible schema change has been detected for table '<entityName>'. To resolve this issue, a full refresh of the table is required on the Managed Ingestion pipeline. Error message: '<errorMessage>'.

INGESTION_GATEWAY_CAPTURE_INSTANCE_UNAVAILABLE

Capture instance for <entityName> is no longer available on the source.

Please trigger a full refresh after enabling CDC or CT on the table.

INGESTION_GATEWAY_CDC_LOG_TRUNCATED

CDC log has been truncated for table '<entityName>', reason: <errorMessage>.

This can be caused by CDC log retention policy truncating change tracking logs before they could be processed.

The table will be skipped from processing. To re-enable processing, please full refresh the table.

INGESTION_GATEWAY_CDC_NOT_ENABLED

CDC is not enabled on <entityType> '<entityName>'. Enable CDC and full refresh the table on the Ingestion Pipeline. Error message: '<errorMessage>'.

INGESTION_GATEWAY_CHARSET_SUPPORT_DISABLED

Charset-aware parsing is disabled but table <entityName> has charset metadata from a previous run. The table will be skipped from replication.

INGESTION_GATEWAY_CONNECTION_PERMISSION_DENIED

User does not have permission to use foreign connection <connectionName>.

INGESTION_GATEWAY_DATABASE_UNAVAILABLE

The source database is unavailable.

For more details see INGESTION_GATEWAY_DATABASE_UNAVAILABLE

INGESTION_GATEWAY_DB_VERSION_NOT_SUPPORTED

Database version is not supported.

For more details see INGESTION_GATEWAY_DB_VERSION_NOT_SUPPORTED

INGESTION_GATEWAY_DDL_NOT_SUPPORTED

CDC Connector encountered a DDL operation on table <entityName> that is not supported for replication.

For more details see INGESTION_GATEWAY_DDL_NOT_SUPPORTED

INGESTION_GATEWAY_DDL_OBJECTS_MISSING

DDL objects missing on <entityType> '<entityName>'. Execute the DDL objects script and full refresh the table on the Ingestion Pipeline. Error message: '<errorMessage>'.

INGESTION_GATEWAY_DML_OPERATION_NOT_SUPPORTED

Table <entityName> has been skipped due to a DML operation that is not supported.

Error message: <errorMessage>

INGESTION_GATEWAY_DML_PARSING_FAILED

CDC Connector failed to parse replicated row data (DML) for table <entityName>.

Error message: <errorMessage>

The Ingestion Gateway's staging volume is not available. Verify the staging volume exists and has not been deleted or renamed; if it has been deleted, recreate the gateway pipeline.

Error message: <errorMessage>

INGESTION_GATEWAY_MISSING_CONNECTION_REFERENCE

Ingestion gateway configuration is missing a connection.

Please add a reference to the Unity Catalog connection containing your credentials.

Ingestion gateway pipeline definition details:

<definition>

INGESTION_GATEWAY_MISSING_INTERNAL_STORAGE_CATALOG

Ingestion gateway configuration is missing the internal storage location catalog.

Please add the internal storage location catalog.

Ingestion gateway pipeline definition details:

<definition>

INGESTION_GATEWAY_MISSING_INTERNAL_STORAGE_NAME

Ingestion gateway configuration is missing the internal storage location name.

Please add the internal storage location name.

Ingestion gateway pipeline definition details:

<definition>

INGESTION_GATEWAY_MISSING_INTERNAL_STORAGE_SCHEMA

INGESTION_GATEWAY_ORACLE_PK_UPDATE_WITHOUT_FULL_SUPPLEMENTAL_LOG

Primary key update detected for Oracle table <entityName> without full supplemental logging.

Non-key column values are not available in the CDC log, so the updated record cannot be fully constructed.

Enable full supplemental logging on the source table, or trigger a full refresh on the failed table.

INGESTION_GATEWAY_ORACLE_TABLE_SKIPPED_DUE_TO_UNSUPPORTED_NAME_LENGTH

Table '<entityName>' has been skipped because a table or column name exceeds the maximum length supported for change data capture. Rename the affected table or columns, or remove them from the ingestion pipeline. Error message: '<errorMessage>'.

INGESTION_GATEWAY_PARTIAL_ROW_UPDATE_MODE_CHANGED

Table <entityName> has been skipped because the partial-row-update mode changed for the pipeline. Full refresh the table to resolve the issue.

Error message: <errorMessage>

INGESTION_GATEWAY_PG_MAX_SLOT_WAL_KEEP_SIZE_UNLIMITED

SQLSTATE: 01000

PostgreSQL max_slot_wal_keep_size is set to unlimited (-1) on the source for catalog <catalogName>. Inactive or lagging replication slots may retain unbounded WAL data and exhaust disk space. Consider setting a finite limit.

Details: <errorMessage>

INGESTION_GATEWAY_PG_NOT_PRIMARY

PostgreSQL source for <entityType> <entityName> is not a primary server. Logical replication requires a primary. Point the connection at a primary and trigger a full refresh on all destination tables mapped to catalog <catalogName>.

Error message: <errorMessage>

INGESTION_GATEWAY_PG_PUBLICATION_ALTER_FAILED

Failed to alter replication publication for <entityType> '<entityName>'

Error message: <errorMessage>

For more details see INGESTION_GATEWAY_PG_PUBLICATION_ALTER_FAILED

INGESTION_GATEWAY_PG_PUBLICATION_CREATION_FAILED

Failed to create replication publication for <entityType> '<entityName>'

Error message: <errorMessage>

For more details see INGESTION_GATEWAY_PG_PUBLICATION_CREATION_FAILED

INGESTION_GATEWAY_PG_PUBLICATION_DROP_FAILED

Failed to drop replication publication for <entityType> '<entityName>'

Error message: <errorMessage>

For more details see INGESTION_GATEWAY_PG_PUBLICATION_DROP_FAILED

INGESTION_GATEWAY_PG_PUBLICATION_HAS_BEEN_DELETED

The PostgreSQL publication for <entityType> '<entityName>' has been deleted. The publication may have been dropped mid replication. Please verify the publication exists and recreate it if necessary, then trigger a full refresh on all the destination tables.

Error message: <errorMessage>

INGESTION_GATEWAY_PG_SLOT_CONFIG_IS_INVALIDATED

Replication slot config for <entityType> <entityName> is not in a healthy state. To resolve this issue, trigger a full refresh on all the destination tables mapped to catalog <catalogName>.

Error message: <errorMessage>

Replication slot for <entityType> '<entityName>' has been deleted. Please trigger a full refresh on all the destination tables mapped to catalog '<catalogName>'.

Error message: <errorMessage>

INGESTION_GATEWAY_PG_SLOT_IS_INVALIDATED

Replication slot for <entityType> '<entityName>' is not in a healthy state. Please drop the slot and trigger a full refresh on all the destination tables mapped to catalog '<catalogName>'.

Error message: <errorMessage>

INGESTION_GATEWAY_PG_WAL_LEVEL_NOT_LOGICAL

PostgreSQL source for <entityType> <entityName> does not have wal_level=logical. Logical replication requires wal_level=logical. Update the server configuration and trigger a full refresh on all destination tables mapped to catalog <catalogName>.

Error message: <errorMessage>

INGESTION_GATEWAY_PG_WAL_SEGMENT_REMOVED

The required PostgreSQL WAL segment has already been removed on the source database. This typically happens when the replication slot falls too far behind and PostgreSQL reclaims WAL segments. To mitigate, run a full refresh on all tables and ensure the replication slot does not fall behind.

Error message: <errorMessage>

INGESTION_GATEWAY_PIPELINE_SPEC_VALIDATION_ERROR

For more details see INGESTION_GATEWAY_PIPELINE_SPEC_VALIDATION_ERROR

INGESTION_GATEWAY_SOURCE_INSUFFICIENT_PERMISSION_FAILURE

The user does not have the required permissions to perform the requested operation on the source. Ensure that all necessary privileges are granted. <errorMessage>

INGESTION_GATEWAY_SOURCE_OBJECT_NOT_FOUND

The Ingestion Gateway could not find an object it needs to read changes from the source, such as a source table or a redo/transaction log. Error message: '<errorMessage>'

INGESTION_GATEWAY_SOURCE_RESOURCE_EXHAUSTED

SQLSTATE: 53000

The Ingestion Gateway exhausted a system resource, such as memory or open file handles. This issue may be transient; retry the pipeline and contact Databricks support if it persists. Error message: '<errorMessage>'

INGESTION_GATEWAY_SOURCE_SCHEMA_MISSING_ENTITY

No tables are available for replication from the source.

Verify that the tables are correctly selected and defined in the ingestion pipeline

and user has the necessary catalog and schema access.

INGESTION_GATEWAY_SOURCE_TOO_MANY_CONNECTIONS

SQLSTATE: 53300

The source database rejected new connections because its maximum connection limit was reached. This pipeline alone needs approximately <connectionsRequired> connections on the source at peak (during the initial snapshot of all catalogs). If other pipelines or workloads share this source, the source's max_connections must accommodate all of them concurrently. To check current usage, run these queries on the source as a superuser or pg_read_all_stats member (otherwise the count is incomplete): SHOW max_connections; and SELECT count(*) FROM pg_stat_activity WHERE backend_type = 'client backend';. Increase max_connections on the source database or reduce pipeline parallelism.

Error message: <errorMessage>

INGESTION_GATEWAY_SQL_SERVER_AGENT_NOT_RUNNING

SQL Server Agent is not running for table '<entityName>'. CDC replication cannot proceed until the agent is restarted.

Please restart the SQL Server Agent and replication will resume automatically.

Error message: <errorMessage>

INGESTION_GATEWAY_SQL_SERVER_CDC_CAPTURE_INSTANCE_LSN_AHEAD_OF_MAX_LSN_OF_DATABASE

Table <entityName> was skipped during reinitialization because its new CDC capture instance has not yet been processed by SQL Server's internal CDC jobs (its minimum LSN is still ahead of the database's maximum LSN).

This typically happens when SQL Server Agent is stopped, the 'sp_cdc_scan' job has not run for a long time, or CDC cleanup on the source is too aggressive.

Ensure SQL Server Agent and the CDC scan jobs are running, then trigger a full refresh of the table.

Error message: <errorMessage>

INGESTION_GATEWAY_SQL_SERVER_CT_DISABLED

Change Tracking for table <entityName> has been disabled on the source.

Please trigger a full refresh after enabling CDC or CT on the table.

INGESTION_GATEWAY_SQL_SERVER_CT_NOT_SUPPORTED_ON_REPLICA

Change Tracking is not supported on secondary availability replica for table <entityName>.

To enable replication, either:

Connect to the primary replica, or
Use CDC instead of Change Tracking if replicating from a replica is required.

Error message: <errorMessage>

INGESTION_GATEWAY_SQL_SERVER_UNSUPPORTED_NON_TRIGGER_BASED_DDL_SETUP

Failed to replicate table due to improper non-trigger based DDL setup

For more details see INGESTION_GATEWAY_SQL_SERVER_UNSUPPORTED_NON_TRIGGER_BASED_DDL_SETUP

INGESTION_GATEWAY_STATEMENTS_ERROR

Connection failed due to a TLS/SSL error.

This typically means the server certificate could not be verified.

Provide a valid CA certificate or set trustServerCertificate to true.

INGESTION_GATEWAY_TLS_SETUP_FAILURE

Failed to set up TLS/SSL connection.

Error: <errorMessage>.

INGESTION_GATEWAY_TLS_VALIDATION_FAILURE

TLS configuration validation failed.

Error: <errorMessage>.

INGESTION_GATEWAY_UNEXPECTED_COLUMN_UOID

SQLSTATE: 0AXX1

Table '<entityName>' has been skipped due to unexpected UOID assigned to columns. Please perform a full refresh on the table to resolve the issue. Error: <errorMessage>.

INGESTION_GATEWAY_UNEXPECTED_TABLE_UOID

SQLSTATE: 0AXX2

Table '<entityName>' has been skipped due to unexpected UOID assigned to table. Please perform a full refresh on the table to resolve the issue. Error: <errorMessage>.

INGESTION_GATEWAY_UNREACHABLE_HOST_OR_PORT_FAILURE

Connection failed due to an incorrect hostname <host> and/or port <port> of the source database.

For more details see INGESTION_GATEWAY_UNREACHABLE_HOST_OR_PORT_FAILURE

INGESTION_GATEWAY_UNSUPPORTED_CHARS_IN_OBJECT_NAME

SQLSTATE: 42XXX

Unsupported chars found in objects for table <entityName>, reason: <errorMessage>. The table will be skipped. Contact support to enable ingestion of special characters.

INGESTION_GATEWAY_UNSUPPORTED_FEATURE_OR_TYPE

The Ingestion Gateway encountered a feature or data type it does not support. Error message: '<errorMessage>'

INGESTION_GATEWAY_UNSUPPORTED_OBJECT_TYPE

Object '<entityName>' is unsupported and has been skipped. To resolve, remove this object from ingestion pipeline. Error message: '<errorMessage>'.

INGESTION_GATEWAY_UNSUPPORTED_SCHEMA_CHANGE

An unsupported schema change has been detected for table <entityName>. To resolve this issue, run a full refresh of the table on the Managed Ingestion pipeline. Error message: <errorMessage>.

INGESTION_GATEWAY_UNTRACEABLE_TABLE_MODIFICATION

Untraceable table modification detected for table <entityName>, reason: <errorMessage>.

This can be caused by a table truncate, cdc log rollover, or other untraceable operation.

The table will be skipped from processing. To re-enable processing, please full refresh the table.

INGESTION_GATEWAY_XA_TRANSACTION_NOT_SUPPORTED

INVALID_DESTINATION_PIPELINE_ID

Spark Declarative Pipelines on Lakeflow only supports environment version '3' and above.

INVALID_REFRESH_SELECTION

For more details see INVALID_REFRESH_SELECTION

INVALID_REFRESH_SELECTION_REQUEST_FOR_CONTINUOUS_PIPELINE

Refresh selection is not supported for the continuous mode.

INVALID_REFRESH_SELECTION_REQUEST_WITH_FULL_REFRESH

full_refresh should not be set to true for a refresh selection request.

INVALID_REPLACE_WHERE_OVERRIDE

Invalid usage of replace_where_overrides:

For more details see INVALID_REPLACE_WHERE_OVERRIDE

INVALID_REWIND_SPECIFICATION

The rewind specification is invalid

For more details see INVALID_REWIND_SPECIFICATION

INVALID_ROOT_PATH

Invalid root_path '<rootPath>': only absolute directory paths are currently supported. Directory paths must begin with '/' and not end with '/'.

INVALID_SCHEMA_NAME

Invalid schema '<schemaName>' specified in the pipeline setting. Reason: <reason>.

INVALID_SNAPSHOT_AND_VERSION_TYPE

snapshot_and_version for flow with target '<target>' returned unsupported type. <additionalMsg>.

INVALID_TRIGGER_INTERVAL_FORMAT

The trigger interval configuration specified in the <configurationType> is invalid

JIRA_ACCESS_FORBIDDEN

An error occurred in Jira connector. Source API type: <saasSourceApiType>.

The connecting user does not have access. Kindly re-check permissions of the user and try again.

JIRA_ADMIN_PERMISSION_MISSING

Error encountered while calling Jira APIs. Source API type: <saasSourceApiType>.

Ensure the connecting user has Jira admin permissions for your Jira instance.

JIRA_ADMIN_PERMISSION_REQUIRED_FOR_TABLES

The connecting Jira user lacks admin permissions required by some selected tables. Required permission -> tables that need it: <tables>.

Grant the connecting user the listed permission in Jira (Settings > System > Global permissions for 'Administer Jira'; the project's permission scheme for 'Administer Projects'), then retry. Alternatively, remove the listed tables from the pipeline.

JIRA_AUDIT_LOG_EVENT_MALFORMED

Jira audit log event '<summary>' is malformed and cannot be classified for the user_group table: <reason>. File a support ticket if the issue persists.

JIRA_AUDIT_LOG_REQUIRES_PAID_PLAN

Audit Logs fetching is restricted to Premium and Enterprise plans only. Upgrade your Jira plan to continue.

Referencing datasets using LIVE virtual schema outside the dataset query definition (i.e., @dlt.table annotation) is not supported.

LIVE_REFERENCE_OUTSIDE_QUERY_DEFINITION_DPM

Referencing datasets using LIVE virtual schema <identifier> outside the dataset query definition (i.e., @dlt.table annotation) is not supported.

LIVE_REFERENCE_OUTSIDE_QUERY_DEFINITION_SPARK_SQL

Referencing datasets using LIVE virtual schema in spark.sql(...) API must not be called outside the dataset query definition (i.e., @dlt.table annotation). It can only be called within the dataset query definition.

MANAGED_INGESTION_AUTO_FULL_REFRESH_NOT_SUPPORTED_FOR_SCD_TYPE_2

Auto Full Refresh is not supported for SCD Type 2. Please disable auto full refresh or use a different SCD type.

MANAGED_INGESTION_CANNOT_CHANGE_SOURCE_FOR_EXISTING_DESTINATION_TABLE

Changing source from <existingSourceIdentifier> to <newSourceIdentifier> is not allowed for destination table <destinationTable>.

Please map the new source to a new destination table.

MANAGED_INGESTION_GATEWAY_PERMISSION_DENIED

The user is not allowed to ingest CDC data using this ingestion gateway.

MANAGED_INGESTION_MV_SYNC_METADATA_FAILED

REPAIR TABLE SYNC METADATA failed for materialized view <tableName>.

MANAGED_INGESTION_PIPELINE_DISABLED

Managed ingestion pipelines are disabled for this workspace.

MANAGED_INGESTION_PIPELINE_SPEC_VALIDATION_ERROR

For more details see MANAGED_INGESTION_PIPELINE_SPEC_VALIDATION_ERROR

MANAGED_INGESTION_TOO_MANY_CLUSTERING_COLUMNS

Table <tableName> specifies <columnCount> clustering columns, but the maximum allowed is <maxColumns>. Reduce the number of clustering columns in the table configuration.

MANAGED_INGESTION_UNSUPPORTED_FILE_FORMAT

Unsupported file format <fileFormat> for file source connector. Only BINARYFILE format is supported.

MANAGED_TABLE_DOES_NOT_SUPPORT_CDC

Cannot apply <apiName> against managed table <target>.

Managed tables (registered via the create_table() API or CREATE TABLE name FLOW ...) do not support CDC change flows.

Use create_streaming_table() for the target instead, or remove the <apiName> call.

MARKETO_ACCESS_DENIED

Marketo denied access for the <saasSourceApiType> request (requestId <requestId>): <errorMessage>.

The Marketo API user backing this connection lacks permission for this operation. Grant the API-Only role the required read permissions in Marketo, then re-run the pipeline.

If the error still persists, file a ticket.

MARKETO_ACCESS_TOKEN_INVALID

Marketo rejected the access token for connection <connectionName>, even after an automatic token refresh.

The credentials on the connection are invalid, expired, or revoked. Edit the connection with a valid Marketo Custom Service client id and secret, then re-run the pipeline.

If the error still persists, file a ticket.

MARKETO_BULK_JOB_FAILED

A Marketo Bulk Extract job did not complete successfully: <detail>.

Re-run the pipeline. If the error still persists, file a ticket.

Marketo ingestion reached an unexpected internal state: <detail>.

Please file a ticket.

Marketo rejected a byte-range download of the Bulk Extract file as not satisfiable (<context>).

File a ticket.

Query function for materialized view '<datasetName>' returned a streaming DataFrame.

It must return a non-streaming DataFrame.

MATERIALIZED_VIEW_USING_ICEBERG_CONFLICTING_PROPERTY

Cannot create the materialized view with USING ICEBERG because the table property '<property>' is set to '<specifiedValue>', which conflicts with the value '<requiredValue>' required for Delta UniForm Apache Iceberg.

Remove the conflicting table property or set it to '<requiredValue>'.

MATERIALIZED_VIEW_USING_ICEBERG_NOT_ENABLED

USING ICEBERG is not supported for materialized views in this environment.

MAX_RETRY_REACHED_BEFORE_ENZYME_RECOMPUTE

Max retry count reached. Retry count:<flowRetryCount>. maxFlowFailureRetryCountThreshold:<maxFlowRetryAttempts>. <message>

MERGE_FLOW_CONDITION_REQUIRED

MERGE flow requires a merge condition.

MERGE_FLOW_EXPECTATIONS_NOT_SUPPORTED

Expectations are not supported on MERGE flows (dataset <datasetName>).

MERGE_FLOW_INVALID_ASSIGNMENT_TARGET

Invalid MERGE flow assignment target <target>.

MERGE_FLOW_NOT_ENABLED

Operations involved in updating the metastore information for <tableName> took longer than <timeout>.

This issue may be transient or could indicate bugs in the configured metastore client. Try restarting your pipeline and report this issue if it persists.

META_ADS_EMPTY_AD_ACCOUNTS_LIST

An error occurred in the Meta Ads connector.

The API call failed due to unavailability of any ad accounts associated with the provided credentials. Please ensure the authenticated user has access to at least one ad account and retry.

META_ADS_INSIGHTS_LEVEL_INVALID

An error occurred in the Meta Ads connector while trying to fetch insights for the ad_insights table.

The provided level parameter <level> is invalid. Please pass one of (ad, adset, campaign, account).

META_ADS_INSIGHTS_PARAM_BREAKDOWNS_INVALID

An error occurred in the Meta Ads connector while trying to fetch insights for the ad_insights table.

The provided breakdowns param <breakdowns> are invalid. Please check meta API documentation for valid list of breakdowns.

If the error persists, file a ticket.

META_ADS_INSIGHTS_PARAM_TIME_INCREMENT_INVALID

An error occurred in the Meta Ads connector while trying to fetch insights for the ad_insights table.

The provided time increment parameter <timeInc> could not be parsed. Please enter a valid integer number.

META_ADS_INSIGHTS_START_DATE_INVALID

An error occurred in the Meta Ads connector while trying to fetch insights for the ad_insights table.

The provided start date parameter <startDate> could not be parsed. Please check and modify it in correct YYYY-MM-DD format.

META_ADS_INSIGHTS_START_DATE_TOO_OLD

Table '<tableName>' is already managed by pipeline <otherPipelineId>.

If you want table '<tableName>' to be managed by this pipeline -

Remove the table from pipeline '<otherPipelineId>'.
Start a full refresh update for this pipeline.

Note that only tables are counted towards this check. You may also encounter this error if you only include views or flows in your pipeline.

OUTPUT_MODE_NOT_SUPPORTED_FOR_TABLE_FLOW

Output mode '<outputMode>' is not supported for table flow '<flowName>' targeting table '<target>'. Only 'append' mode is supported for table flows.

OWNER_IS_MISSING

Owner does not exist.

PAGINATION_REQUEST_HAS_NAME_AND_PAGINATION

You can provide a <name> or pagination, but not both.

PATCH_DEFINITION_UNSUPPORTED_FOR_METRIC_VIEW

Patching the definition of a metric view pipeline is not supported.

Metric view definitions are managed via CREATE VIEW / ALTER VIEW; patch is restricted to

ownership changes for pipeline '<pipelineId>'.

PATCH_PIPELINE_DEFINITION_UNSUPPORTED_FIELD

PatchPipelineDefinition only supports the schedule field, but the provided definition had other populated fields: '<updatedDefinition>'.

PERFORMANCE_TARGET_IN_START_UPDATE_NOT_ENABLED

Setting performance_target in StartUpdate is not enabled for this pipeline.

PERFORMANCE_TARGET_REQUIRES_SELECTIVE_FULL_REFRESH

PIPELINE_ENVIRONMENT_NOT_ENABLED

Using environment in Spark Declarative Pipelines on Lakeflow is not enabled.

PIPELINE_ENVIRONMENT_VERSION_NOT_ALLOWED

The pipeline's environment currently does not support environment versions.

For more details see PIPELINE_ENVIRONMENT_VERSION_NOT_ALLOWED

PIPELINE_ENVIRONMENT_VERSION_PREFLIGHT_VALIDATION_FAILED

Environment Version enablement validation failed.

Detected patterns from update '<previousUpdateId>' that could lead to behavior changes when switching to Spark Connect.

Review the behavior change warnings from the previous update <previousUpdateId> for details.

PIPELINE_FAILED_TO_UPDATE_UC_TABLE_DUE_TO_CONCURRENT_UPDATE

Pipeline failed to update the UC table (<tableName>) due to concurrent alters after <attempts> attempts.

Please verify there aren't external processes modifying the table, retry the update, and contact Databricks support if this issue persists.

PIPELINE_FAILED_TO_UPDATE_UC_TABLE_DUE_TO_EXTERNAL_DELETE

The table <tableName> was deleted by an external operation while the pipeline was updating it.

Ensure no external processes are modifying the table, then retry the update.

If the issue persists, contact Databricks Support.

PIPELINE_FOR_TABLE_NEEDS_REFRESH

The table <tableName> is not in the required state, the table has not been updated recently. The pipeline with ID '<pipelineId>' must be run once more and then retry the operation.

PIPELINE_FOR_TABLE_NOT_FOUND

The pipeline with ID '<pipelineId>', managing the table <tableName>, can not be found. Make sure you are in the same workspace as the pipeline, you are the owner of the pipeline, and the pipeline ran at least once.

PIPELINE_GLOB_INCLUDES_CONFLICTS

Either glob or notebook/file field under libraries in the pipeline settings should be set. Please change the pipeline settings.

PIPELINE_GLOB_INCLUDES_NOT_SUPPORTED

Using glob field to include source files is a preview feature and is disabled.

Re-select each source file to include for the pipeline to fix this error.

Reach out to Databricks support to learn more about this feature and enroll in the preview.

PIPELINE_GLOB_SINGLE_ASTERISK_UNSUPPORTED

Single asterisk glob pattern is not supported in included path '<path>' in pipeline settings. Use a double asterisk '**' to match files recursively (for example, '/path/to/dir/**')

PIPELINE_GLOB_UNSUPPORTED_SPECIAL_CHARACTER

Special characters <specialChar> are reserved and should not be used in included path '<path>' in pipeline settings. Remove these characters to fix the error

PIPELINE_INCLUSION_ENTRY_LIMIT_EXCEEDED

This pipeline has too many included entries and exceeds the limit of <limit>.

The table is not ready for refresh yet

For more details see PIPELINE_NOT_READY_FOR_SCHEDULED_UPDATE

PIPELINE_PERMISSION_DENIED_NOT_OWNER

You are not allowed to perform this operation. You are not the owner of the pipeline with ID '<pipelineId>', managing the table <tableName>.

PIPELINE_RETRYABLE_ANALYSIS

The number of source files, including files declared in directories, exceeds the limit of <limit>.

PIP_INSTALL_WITHIN_NOTEBOOK_CELL_NOT_SUPPORTED_WITH_ENVIRONMENT_VERSION

%pip install within notebook cell is not supported when using Environment Version.

The library you tried to install was: <command> at cell <cellIdx> in notebook <notebookPath>

Please install the library using the "Environment" settings in the pipeline settings.

For example, to install library 'pandas', you can add the following to the "Environment" settings:

"environment": {

"dependencies": [

An error occurred in the <sourceName> API call. Source API type: <qbcSourceApiType>.

Try refreshing the destination table. If the issue persists, please file a ticket.

QUERY_BASED_INGESTION_CONNECTOR_ERROR

Error happened in query-based ingestion connector for <sourceName>.

For more details see QUERY_BASED_INGESTION_CONNECTOR_ERROR

RABBITMQ_BLOCK_NOT_FOUND

RabbitMQ block '<blockId>' not found in BlockManager or checkpoint file '<filePath>'.

RABBITMQ_INVALID_OFFSET

Invalid RabbitMQ offset.

For more details see RABBITMQ_INVALID_OFFSET

RABBITMQ_INVALID_OPTION

Invalid RabbitMQ source option '<optionKey>'.

For more details see RABBITMQ_INVALID_OPTION

RABBITMQ_UC_CONNECTION

Failed to resolve RabbitMQ Unity Catalog connection '<connectionName>'.

For more details see RABBITMQ_UC_CONNECTION

The Reddit Ads API rejected the request during operation '<saasSourceApiType>' because the connection is missing the required OAuth scope '<requiredScope>'.

Make sure the Reddit Ads connection includes the '<requiredScope>' scope, then re-run the pipeline.

REDDIT_ADS_INVALID_CUSTOM_REPORT_CONFIGURATION

Invalid custom_report configuration. <reason>

Check the 'breakdowns' and 'fields' options for the custom_report table in your pipeline configuration. Both options are required and must not repeat a token; breakdowns must include at least one time breakdown (DATE or HOUR); and all breakdown and field names must be valid uppercase tokens documented by the Reddit Ads API.

REDDIT_ADS_INVALID_REPORT_PARAMS

The Reddit Ads report API rejected an invalid parameter during operation '<saasSourceApiType>'.

Invalid value at '<fieldPath>': <fieldMessage>

Check the 'breakdowns' and 'fields' options in your pipeline configuration for the custom_report table. Ensure all breakdown and field names are valid uppercase strings as documented by the Reddit Ads API.

REDDIT_ADS_RATE_LIMIT_EXCEEDED

The Reddit Ads API call failed due to rate limits after exhausting all retries. Operation: '<saasSourceApiType>'.

Reddit Ads enforces 60 requests/minute for report endpoints and 400 requests/minute for entity endpoints.

To resolve this, reduce the number of tables ingested in parallel, or split the tables into separate pipelines scheduled to run at different times to spread the load.

If the error persists, file a ticket.

REDDIT_ADS_RESOURCE_NOT_FOUND

The Reddit Ads API returned 404 (resource not found) during operation '<saasSourceApiType>'.

The requested resource either does not exist, or the Reddit Ads connection does not have access to it.

Verify the resource exists and that the connection has access to it. If it does and the error persists, file a ticket.

REFERENCE_DLT_DATASET_OUTSIDE_QUERY_DEFINITION

Referencing pipeline dataset <identifier> outside the dataset query definition (i.e., @dlt.table annotation) is not supported. Please read it instead inside the dataset query definition.

REFRESH_INITIATED_FROM_INVALID_WORKSPACE

REPLACE_USING_REQUIRES_SEQUENCE_BY

Please contact Databricks support for assistance in restoring pipeline '<pipelineId>'.

ROOT_PATH_NOT_FOUND

Unable access root path '<rootPath>'. Please ensure you have the required access privileges.

RUN_AS_USER_NOT_FOUND

The specified run as user '<runAsUserId>' for the update does not exist in the workspace.

SAAS_CONNECTION_ERROR

Failed to make a connection to the <sourceName> source. Error code: <saasConnectionErrorCode>.

For more details see SAAS_CONNECTION_ERROR

SAAS_CONNECTOR_DUPLICATE_DATA

Found duplicate data in the table <tableName>. Source type: <sourceName>.

For more details see SAAS_CONNECTOR_DUPLICATE_DATA

SAAS_CONNECTOR_INVALID_INCLUDE_COLUMNS

Invalid include_columns specified for table <qualifiedTableName>. Reason: <reason>

SAAS_INCOMPATIBLE_SCHEMA_CHANGES_DURING_INIT

We have detected incompatible schema changes when initializing the pipeline:

<details>

Please perform a full refresh on the impacted tables.

SAAS_PARTIAL_ANALYSIS_INPUT_CREATION_ERROR

Error encountered while creating input for partial analysis. A new pipeline update will not be created.

Please check the event log and fix the issues accordingly.

SAAS_SCHEMA_DIVERGED_DURING_ANALYSIS

The source table (<table>)'s analyzed schema has diverged from its expected schema.

Please retry the pipeline update and see if the issue is resolved.

If this issue persists, please perform a full refresh on the tables mentioned above

Expected schema:

<expectedSchema>

Actual schema:

<actualSchema>

SAAS_UC_CONNECTION_INACCESSIBLE

The provided Connection <connectionName> is inaccessible. Please check the connection and try again.

For more details see SAAS_UC_CONNECTION_INACCESSIBLE

SAAS_UC_CONNECTION_IN_FAILED_STATE

The connection <connectionName> is in the failed state. Please update the connection with valid credentials and try again.

SANDBOX_PIPELINE_RUN_NOT_ALLOWED

Cannot start a run for sandbox pipeline '<pipelineId>'. Sandbox pipelines do not support data writes and can only be started with explore_only=true.

SANDBOX_PIPELINE_STILL_INITIALIZING

Sandbox pipeline '<pipelineId>' is still being initialized (its notebooks are being copied). Retry once the pipeline reaches the IDLE state.

SCHEDULED_REFRESH_NOT_SUPPORTED_WITH_TEMP_VIEWS

Scheduled refreshes are not supported for <tableType> '<tableName>' because it references temporary views in its definition.

Temporary views are session-scoped and will not be available when the scheduled refresh runs.

Please remove the SCHEDULE clause or rewrite the query to use persisted views or tables instead.

SCHEMA_EXPLORATION_INVALID_REQUEST

Failed to enumerate source objects: the request is invalid (<exceptionType>: <causeMessage>).

SCHEMA_EXPLORATION_REQUIRES_INGESTION_PIPELINE

Schema exploration is only supported for ingestion pipelines.

SCHEMA_SPEC_EMPTY_CATALOG

SQLSTATE: 3D000

SchemaSpec has an empty string in the catalog field.

Please remove the empty string or add the catalog name. (If this schema doesn't belong to a catalog in the source, do not set the field.)

Schema spec details:

<schemaSpec>

SCHEMA_SPEC_EMPTY_SCHEMA

SchemaSpec has an empty string in the schema field.

Please remove the empty string or add the schema name. (If this table doesn't belong to a schema in the source, do not set the field.)

Schema spec details:

<schemaSpec>

SCHEMA_SPEC_REQUIRE_ONE_OF_CATALOG_SCHEMA

Serverless compute is not available for this workspace and/or region. Please contact Databricks for more information.

SERVERLESS_REQUIRED

You must use serverless compute in this workspace.

SERVICENOW_CONNECTION_ERROR

An error occurred in ServiceNow. Source API type: <saasSourceApiType>.

For more details see SERVICENOW_CONNECTION_ERROR

An error occurred in ServiceNow. Source API type: <saasSourceApiType>.

This often happens when the data fetch for a table takes too long. As a first step, work with your ServiceNow administrator to enable indexing on the cursor column.

The cursor column is selected from the following list, in order of availability and preference: sys_updated_on (first choice), sys_created_on (second choice), sys_archived (third choice)

For instructions on enabling indexing in ServiceNow, see here: https://docs.databricks.com/ingestion/lakeflow-connect/servicenow-overview#why-is-my-servicenow-ingestion-performance-slow.

We also recommend increasing the 'REST API query timeout' to more than 60 seconds to allow more time to fetch records.

To increase the timeout, visit ServiceNow >> All >> Transaction Quota Rules and increase the mentioned timeout.

Then, retry your ingestion pipeline. If the issue persists, file a ticket.

SERVICENOW_CONNECTOR_SCHEMA_FIELD_TYPE_INACCESSIBLE

An error occurred in the ServiceNow. Source API type: <saasSourceApiType>.

While fetching the table schema with non-admin privileges, the internal_type of the schema columns is not accessible.

To resolve this, give read permissions on the table ‘sys_glide_object’ to the current user.

If the error persists, file a ticket.

SERVICENOW_CONNECTOR_UNAUTHORIZED_ACCESS_ERROR

An error occurred in ServiceNow. Source API type: <saasSourceApiType>.

For more details see SERVICENOW_CONNECTOR_UNAUTHORIZED_ACCESS_ERROR

SET_TBLPROPERTIES_NOT_ALLOWED_FOR_PIPELINE_TABLE

SQLSTATE: 0AKLT

ALTER <commandTableType> ... SET TBLPROPERTIES is not supported. To modify table properties, please change the original definition and run an update.

Ingestion for object <objName> is incomplete because creation of Salesforce bulk API query job failed. Error code: <saasSourceApiErrorCode>.

<actionText>.

SFDC_CONNECTOR_MALFORMED_RECORDS

Ingestion for Salesforce object '<objName>' failed because Salesforce <saasSourceApiType> returned malformed records.

Please check the stacktrace for more details.

Verify the data in Salesforce and re-run the pipeline.

SFDC_CONNECTOR_MISSING_SOBJECT_NAME

The SharePoint list could not be resolved from the provided connector options: <details>.

Verify that the list URL points to a valid SharePoint list.

SINKS_NOT_SUPPORTED_IN_SEG

Pipeline sinks are not supported in serverless egress control enabled workspaces. Supported pipeline sinks are Delta, jdbcStreaming, Kafka, and postgresql.

The following unsupported sinks are found: <sinkNames>, their corresponding formats are: <sinkFormats>.

SMARTSHEET_CONNECTOR_API_ERROR

An error occurred in Smartsheet. Source API type: <saasSourceApiType>. Error code: <saasSourceApiErrorCode>.

Try refreshing the destination table. If the issue persists, file a ticket.

SMARTSHEET_CONNECTOR_AUTHENTICATION_FAILED

An error occurred in Smartsheet. Source API type: <saasSourceApiType>.

Authentication failed. Your access token may be invalid, expired, or require Single Sign-On.

Verify that your Smartsheet access token is valid and has the required permissions.

If the error persists, file a ticket.

An error occurred in Smartsheet.

Invalid region: '<region>'. Supported regions are: us, eu, au.

Update the region in your connection configuration.

SMARTSHEET_CONNECTOR_MALFORMED_EVENT

Smartsheet returned an event missing a required field. Event ID: <eventId>. Missing field: <missingField>.

This indicates an API contract violation. Contact Smartsheet support with the event ID, or file a ticket with the Lakeflow Connect team.

SMARTSHEET_CONNECTOR_RATE_LIMITED

An error occurred in Smartsheet. Source API type: <saasSourceApiType>.

The Smartsheet API rate limit has been exceeded.

Try refreshing the destination table. If the issue persists, file a ticket.

SMARTSHEET_CONNECTOR_RESOURCE_NOT_FOUND

An error occurred in Smartsheet. Source API type: <saasSourceApiType>.

The requested resource was not found.

Verify that the sheet or report ID is correct and that you have access to it.

If the error persists, file a ticket.

SMARTSHEET_CONNECTOR_TRANSIENT_ERROR

An error occurred in Smartsheet. Source API type: <saasSourceApiType>.

A temporary error occurred (maintenance, timeout, or concurrent update).

Try refreshing the destination table. If the issue persists, file a ticket.

SOURCE_CONNECTOR_REJECTED_REQUEST

The source connector rejected the schema-exploration request: <causeMessage>

SOURCE_CONNECTOR_RPC_REJECTED

The source connector returned an error while enumerating objects (<exceptionType>: <causeMessage>).

SOURCE_DATABASE_QUERY_REJECTED

The source database rejected the schema-exploration query (<exceptionType>: <causeMessage>).

SOURCE_OBJECT_DETAILS_UNSUPPORTED_TYPE

The source object details type <objectType> is not supported.

SOURCE_REQUEST_TIMED_OUT

SQLSTATE: 57014

The source did not respond within the schema-exploration timeout (<exceptionType>: <causeMessage>).

SOURCE_TABLE_NOT_MATERIALIZED

Failed to read dependent dataset '<sourceTableName>' because it is not materialized. Run the entire pipeline to materialize all dependent datasets.

SOURCE_UNREACHABLE

Could not reach the source while enumerating objects (<exceptionType>: <causeMessage>).

Verify network connectivity, DNS, and TLS settings for the source.

Update the table definition to keep only one of PARTITIONED BY or CLUSTER BY / CLUSTER BY AUTO.

STANDALONE_MATERIALIZED_VIEW_STREAMING_TABLE_PREVIEW_CHANNEL_NOT_SUPPORTED

The PREVIEW channel is not supported for materialized views and streaming tables on serverless generic compute. Only the CURRENT channel is supported. Please remove the pipelines.channel property or set it to 'CURRENT'.

STANDALONE_MATERIALIZED_VIEW_STREAMING_TABLE_REQUIRES_OWNER

Resolving streaming view '<viewName>' produces different inputs depending on the downstream consumer flow. This is not supported.

Reference consumer (<referenceConsumerName>): <referenceFlowInputs>.

Mismatched consumer (<newConsumerName>): <newFlowInputs>.

SYNCED_TABLE_USER_ERROR

Table <tableName> is no longer managed by pipeline <pipelineId>.

A concurrent operation (such as a table move) changed the table's owning pipeline during this update. A pipeline can only modify tables it owns, so this update cannot proceed.

Retry the update.

Table name is empty. Please provide a table name.

Table spec details:

<tableSpec>

TABLE_TOKEN_NOT_EXIST_FOR_SCHEMA_EVOLUTION_LEGACY_TABLE

Schema evolution cannot be enabled due to missing metadata. Please trigger a full refresh.

Reason: Snapshot table token must be defined when schema evolution is enabled.

TEST_PIPELINE_NOT_IN_PIPELINE_CONTEXT

TestPipeline.active() must be called from within a pipeline context.

Ensure you are running this code in a pipeline notebook or cluster.

TIKTOK_ADS_ADVERTISER_ERROR

An error occurred in TikTok Ads. Source API type: <saasSourceApiType>. Error code: <errorCode>.

The specified advertiser does not exist or cannot be matched.

Verify that the advertiser ID is correct and that you have access to the advertiser account.

If the error persists, file a ticket.

TIKTOK_ADS_ADVERTISER_NOT_FOUND

TikTok Ads returned an advertiser-not-found error. Source API type: <saasSourceApiType>. Error code: <errorCode>.

TikTok response: <sourceMessage>

The advertiser referenced in your pipeline configuration does not exist or has been deleted in TikTok Ads Manager.

Remove or replace the affected advertiser ID in your pipeline configuration and re-run the pipeline.

TIKTOK_ADS_EMPTY_CUSTOM_REPORT_FIELD

An error occurred in the TikTok Ads connector.

A custom report must specify at least one entry for '<field>'.

Add one or more values to '<field>' in your pipeline configuration and re-run the pipeline.

If you are frequently hitting rate limit errors, apply for a higher rate limit tier in the TikTok developer portal.

If the error persists, file a ticket.

TIKTOK_ADS_UNSUPPORTED_REPORT_TYPE

Clearing the target schema field in is not allowed for UC pipelines. Reason: <reason>.

UC_IAM_ROLE_NON_SELF_ASSUMING

The IAM role for the storage credential was found to be non self-assuming.

Please check your role's trust and IAM policies to ensure that your IAM role can assume itself according to the Unity Catalog storage credential documentation.

UC_NOT_ENABLED

Using UC catalog in Spark Declarative Pipelines on Lakeflow is not enabled.

UC_PIPELINE_CANNOT_PUBLISH_TO_HMS

UC enabled pipelines cannot publish to Hive Metastore. Please choose a different target catalog.

UC_ROOT_STORAGE_CREDENTIAL_DOES_NOT_EXIST

Root storage credential for metastore <metastoreId> does not exist.

Please contact your Databricks representative or consider updating the metastore with a valid storage credential.

For more information, see https://docs.databricks.com/api-explorer/workspace/metastores/update

UC_STORAGE_CREDENTIAL_DOES_NOT_EXIST

Storage credential <credentialId> does not exist.

Please verify that the storage credential has not been deleted, or update the pipeline to reference a valid storage credential.

For more information, see https://docs.databricks.com/api-explorer/workspace/storagecredentials/get

UC_TARGET_SCHEMA_REQUIRED

SQLSTATE: 0AKD0

The target schema field is required for UC pipelines. Reason: <reason>.

UNABLE_TO_INFER_TABLE_SCHEMA

Failed to infer the schema for table <tableName> from its upstream flows.

Please modify the flows that write to this table to make their schemas compatible.

Inferred schema so far:

<inferredDataSchema>

Incompatible schema:

<incompatibleDataSchema>

UNEXPECTED_PIPELINE_SCHEMA_PERMISSION_ERROR

Unexpected error while checking schema permissions for pipeline <pipelineId>. Please contact Databricks support.

UNIFORM_COMPATIBILITY_CANNOT_SET_WITH_ROW_FILTERS_OR_COLUMN_MASKS

Uniform compatibility cannot be set on materialized views or streaming tables that have a row filter or column masks applied.

UNITY_CATALOG_INITIALIZATION_FAILED

Encountered an error with Unity Catalog while setting up the pipeline on cluster <clusterId>.

Ensure that your Unity Catalog configuration is correct, and that required resources (for example, catalog, schema) exist and are accessible.

Also verify that the cluster has appropriate permissions to access Unity Catalog.

Details: <ucErrorMessage>

UNRESOLVED_SINK_PATH

Storage path for sink <identifier> cannot be resolved. Please contact Databricks support.

UNRESOLVED_TABLES_FOR_MAINTENANCE

in the pipeline specification, and move the datasets from this pipeline to the new pipeline.

UNSUPPORTED_CUSTOM_SCHEMA_PREVIEW_ENABLEMENT

USE_CATALOG_IN_HMS

USE CATALOG only supported in UC-enabled Lakeflow pipeline

VIEW_TEXT_NOT_SAVED_IN_UC

Cannot refresh table <tableName> as it does not have a query saved in Unity Catalog. Please contact Databricks support.

WORKDAY_HCM_CONNECTOR_FETCH_BATCH_FAILED

An error occurred in Workday HCM. Source API type: <saasSourceApiType>.

Failed to fetch batch at offset '<offset>'.

An error occurred in Workday Reports. Source API type: <saasSourceApiType>.

The size of the report with URL '<reportUrl>' is greater than 2GB. Please ensure that the report size does not exceed this limit.

If the issue persists, file a ticket.

WORKDAY_REPORTS_CONNECTOR_UNAUTHORIZED_ACCESS_ERROR

An error occurred in Workday Reports. Source API type: <saasSourceApiType>.

For more details see WORKDAY_REPORTS_CONNECTOR_UNAUTHORIZED_ACCESS_ERROR

WORKDAY_REPORT_URL_EMPTY

Workday report URL is empty. At least one report must be provided.

WORKSPACE_QUOTA_EXCEEDED

Cannot start update '<updateId>' because there are already '<maxActiveUpdates>' active pipelines running in this workspace.

ZENDESK_SUPPORT_EMPTY_RESPONSE_ERROR

The Zendesk Support API returned an empty response body for operation <saasSourceApiType>.

This typically means the requested feature is not available on your Zendesk plan, or the connecting user does not have permission to access this resource.

Verify that your Zendesk plan supports the requested tables and that the connecting user has the required permissions.

ZENDESK_SUPPORT_FEATURE_NOT_ENABLED

An error occurred in the Zendesk Support API call. The API request failed because this feature is not enabled for your account.

Contact your Zendesk account administrator to enable this feature, or upgrade your Zendesk plan if necessary.

ZENDESK_SUPPORT_IP_ADDRESS_RESTRICTED

An error occurred in the Zendesk Support API call for source API type <saasSourceApiType>. The Zendesk account has IP address restrictions enabled and the request originated from an IP that is not on the allowlist.

To proceed, add the Databricks egress IPs to the Zendesk account's IP allowlist (Admin Center -> Account -> Security -> Advanced -> IP restrictions).

ZENDESK_SUPPORT_SUBDOMAIN_NOT_RESOLVABLE

SQLSTATE: none assigned

Library installation failed due to an invalid access token.

Description: Occurs when the access token used during library installation is invalid or expired.

Suggested Action: Please retry the library installation. If the issue persists, contact Databricks support.

Miscellaneous

ABAC_BUILTIN_FUNCTION_NOT_SUPPORTED_FOR_RUNTIME_VERSION

DBR version <minVersion> or higher is required to query table <tableFullName>, due to it being protected by an ABAC policy that uses builtin function '<functionName>'.

ABAC_POLICIES_NOT_SUPPORTED_FOR_RUNTIME_VERSION

DBR version <abacDBRMajorVersion>.<abacDBRMinorVersion> or higher is required to query table <tableFullName>, due to it being protected by an ABAC policy.

AZURE_ENTRA_CREDENTIALS_MISSING

SQLSTATE: none assigned

Azure Entra (aka Azure Active Directory) credentials missing.

Ensure you are either logged in with your Entra account

or have setup an Azure DevOps personal access token (PAT) in User Settings > Git Integration.

If you are not using a PAT and are using Azure DevOps with the Repos API,

you must use an Azure Entra access token.

See https://docs.microsoft.com/azure/databricks/dev-tools/api/latest/aad/app-aad-token for steps to acquire an Azure Entra access token.

<pickOrCreateNewCredential>

AZURE_ENTRA_CREDENTIALS_PARSE_FAILURE

SQLSTATE: none assigned

Encountered an error with your Azure Entra (Azure Active Directory) credentials. Please try logging out of

Entra (https://portal.azure.com) and logging back in.

Alternatively, you may also visit User Settings > Git Integration to set

up an Azure DevOps personal access token.

<pickOrCreateNewCredential>

AZURE_ENTRA_LOGIN_ERROR

SQLSTATE: none assigned

Encountered an error with your Azure Active Directory credentials. Please try logging out of

SQLSTATE: none assigned

Could not read remote repository (<repoUrl>).

Credential <credentialName> (<credentialId>) was used<because>.

This Git credential's provider is <gitCredentialProvider> and email / username is <gitCredentialUsername>.

<servicePrincipalHint>

Please go to your remote Git provider to ensure that:

Your remote Git repo URL is valid.
Your personal access token or app password has the correct repo access.

<pickOrCreateNewCredential>

COULD_NOT_RESOLVE_REPOSITORY_HOST

SQLSTATE: none assigned

Could not resolve host for <repoUrl>.

Credential <credentialName> (<credentialId>) was used<because>.

SQLSTATE: none assigned

The link to your GitHub account does not have access. To fix this error:

An admin of the repository must go to https://github.com/apps/databricks/installations/new and install the Databricks GitHub app on the repository.

Alternatively, a GitHub account owner can install the app on the account to give access to the account's repositories.

If the app is already installed, have an admin ensure that if they are using scoped access with the 'Only select repositories' option, they have included access to this repository by selecting it.

Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.

<pickOrCreateNewCredential>

GITHUB_APP_EXPIRED_CREDENTIALS

SQLSTATE: none assigned

Linked GitHub app credentials expired after 6 months of inactivity.

Go to User Settings > Git Integration and try relinking your credentials.

If the problem persists, please file a support ticket.

<pickOrCreateNewCredential>

GITHUB_APP_INSTALL_ON_DIFFERENT_USER_ACCOUNT

SQLSTATE: none assigned

The link to your GitHub account does not have access. To fix this error:

GitHub user <gitCredentialUsername> should go to https://github.com/apps/databricks/installations/new and install the app on the account <gitCredentialUsername> to allow access.
If user <gitCredentialUsername> already installed the app and they are using scoped access with the 'Only select repositories' option, they should ensure they have included access to this repository by selecting it.

Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.

<pickOrCreateNewCredential>

GITHUB_APP_INSTALL_ON_ORGANIZATION

SQLSTATE: none assigned

The link to your GitHub account does not have access. To fix this error:

An owner of the GitHub organization <organizationName> should go to https://github.com/apps/databricks/installations/new and install the app on the organization <organizationName> to allow access.
If the app is already installed on GitHub organization <organizationName>, have an owner of this organization ensure that if using scoped access with the 'Only select repositories' option, they have included access to this repository by selecting it.

Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.

<pickOrCreateNewCredential>

GITHUB_APP_INSTALL_ON_YOUR_ACCOUNT

SQLSTATE: none assigned

The link to your GitHub account does not have access. To fix this error:

Go to https://github.com/apps/databricks/installations/new and install the app on your account <gitCredentialUsername> to allow access.
If the app is already installed, and you are using scoped access with the 'Only select repositories' option, ensure that you have included access to this repository by selecting it.

Refer to https://docs.databricks.com/en/repos/get-access-tokens-from-git-provider.html#link-github-account-using-databricks-github-app for more information.

<pickOrCreateNewCredential>

GITHUB_OAUTH_ENDPOINT_UNAVAILABLE

SQLSTATE: none assigned

Operation failed because the GitHub OAuth endpoint was unavailable: <rootCauseException>.

Please try again later or contact support if the issue persists.

GITHUB_OAUTH_TOKEN_REFRESH_FAILED

SQLSTATE: none assigned

Operation failed because the GitHub OAuth token could not be refreshed: <rootCauseException>.

Please try again or go to Settings > Linked accounts and try relinking your Git provider account.

If the problem persists, please file a support ticket.

GITHUB_OAUTH_UNVERIFIED_USER_EMAIL

SQLSTATE: none assigned

Operation failed because your linked GitHub account could not be refreshed: <rootCauseException>.

Your GitHub account's primary email is not verified. Verify it at https://docs.github.com/en/account-and-profile/how-tos/email-preferences/verifying-your-email-address, then go to Settings > Linked accounts and relink your Git provider account.

GIT_CLI_CANNOT_CHOOSE_CREDENTIAL

SQLSTATE: none assigned

Multiple Git credentials match this repository (<repoUrl>) but none could be automatically selected.

Please select which credential to use for this repository in your Git folder settings.

GIT_CLI_CREDENTIAL_NOT_FOUND

SQLSTATE: none assigned

The selected Git credential for this repository (<repoUrl>) no longer exists or was not found.

Please refresh the page and select a new credential in your Git folder settings.

GIT_CLUSTER_NOT_READY

SQLSTATE: none assigned

The Git cluster is not ready yet (ClusterNotReadyException). This is a transient condition while the cluster starts; please retry.

GIT_CREDENTIAL_GENERIC_INVALID

SQLSTATE: none assigned

Invalid Git provider credentials for repository URL <repoUrl>.

Credential <credentialName> (<credentialId>) was used<because>.

This Git credential's provider is <gitCredentialProvider> and email / username is <gitCredentialUsername>.

<servicePrincipalHint>

Please go to your remote Git provider to ensure that:

You have entered the correct Git user email or username with your Git provider credentials.
Your token has the correct repo access.
Your token has not expired.
If you have SSO enabled with your Git provider, be sure to authorize your token.

<pickOrCreateNewCredential>

GIT_CREDENTIAL_INVALID_PAT

SQLSTATE: none assigned

Invalid Git provider Personal Access Token credentials for repository URL <repoUrl>.

Credential <credentialName> (<credentialId>) was used<because>.

This Git credential's provider is <gitCredentialProvider> and email / username is <gitCredentialUsername>.

<servicePrincipalHint>

Please go to your remote Git provider to ensure that:

You have entered the correct Git user email or username with your Git provider credentials.
Your token has the correct repo access.
Your token has not expired.
If you have SSO enabled with your Git provider, be sure to authorize your token.

<pickOrCreateNewCredential>

GIT_CREDENTIAL_MISSING

SQLSTATE: none assigned

No Git credential configured, but credential required for this repository (<repoUrl>).

<servicePrincipalHint>

Go to User Settings > Git Integration to set up your Git credentials.

GIT_CREDENTIAL_NO_ACCESS

SQLSTATE: none assigned

Access to <gitCredentialProvider> repository (<repoUrl>) not granted.

Credential <credentialName> (<credentialId>) was used<because>.

This Git credential's provider is <gitCredentialProvider> and email / username is <gitCredentialUsername>.

The configured credential does not have read access to this repository. Make sure you (<gitCredentialUsername>) have access to this remote repository.

GIT_CREDENTIAL_NO_WRITE_PERMISSION

SQLSTATE: none assigned

Write access to <gitCredentialProvider> repository (<repoUrl>) not granted.

Credential <credentialName> (<credentialId>) was used<because>.

This Git credential's provider is <gitCredentialProvider> and email / username is <gitCredentialUsername>.

<servicePrincipalHint>

Make sure you (<gitCredentialUsername>) have write access to this remote repository.

GIT_CREDENTIAL_PROVIDER_MISMATCHED

SQLSTATE: none assigned

Incorrect Git credential provider for repository.

You do not have a Git credential with a Git provider (<repositoryGitProvider>) that matches that of the repository's Git provider <repoUrl>.

<servicePrincipalHint>

Go to User Settings > Git Integration to create a new credential for Git provider <repositoryGitProvider>.

GIT_FILE_NAME_TOO_LONG

SQLSTATE: none assigned

File or folder name(s) in path <path> exceed the <maxComponentBytes>-byte maximum per component.

Unix-based systems only support up to <maxComponentBytes> bytes per file or folder name.

Violations: <violations>

Please rename or delete the offending file or folder to proceed.

GIT_OPERATION_IN_PROGRESS

SQLSTATE: none assigned

Another git operation is in progress. Please try again later.

If you are sharing this Git folder with others, each user should have their own Git folder.

GIT_PROVIDER_INFO_MISSING

SQLSTATE: none assigned

Git provider information is missing or empty.

Please add the git credential information and try again.

If the problem persists, please file a support ticket.

SQLSTATE: none assigned

Your Git provider requires a CAPTCHA to be solved before Git operations can proceed.

This is typically caused by too many failed login attempts, which locked your account.

Visit <captchaUrl> in a browser to solve the CAPTCHA and unlock your account.

Git error: <gitErrorMessage>

GIT_SECRET_IN_CODE

SQLSTATE: none assigned

Secrets found in the commit. Detail: <secretDetail>. To fix this error:

Remove the secret and try committing again.

If the problem persists, please file a support ticket.

GIT_STALE_REMOTE_REFS

SQLSTATE: none assigned

Git fetch completed but could not update stale remote references due to filesystem path conflicts (for example, deleted branches or 'feature' vs 'feature/sub').

Git error: <gitErrorMessage>

HIERARCHICAL_NAMESPACE_NOT_ENABLED

The Azure storage account does not have Hierarchical Namespace (HNS) enabled, which is required for ADLS Gen2 storage used by Unity Catalog. Enable HNS on the storage account or use a storage account with HNS enabled. See Azure documentation for instructions: https://learn.microsoft.com/azure/storage/blobs/upgrade-to-data-lake-storage-gen2-how-to

INVALID_FIELD_LENGTH

<rpcName> <fieldName> too long. Maximum length is <maxLength> characters.

INVALID_PARAMETER_VALUE

SQLSTATE: none assigned

Remote repository (<repoUrl>) not found.

Credential <credentialName> (<credentialId>) was used<because>.

This Git credential's provider is <gitCredentialProvider> and email / username is <gitCredentialUsername>.

<servicePrincipalHint>

Please go to your remote Git provider to ensure that:

Your remote Git repo URL is valid.
Your personal access token or app password has the correct repo access.

Secondary index <indexFullName> cannot be used because the base table <baseTableFullName> has row-level security, column masking policies, or ABAC policies.

SERVERLESS_NOT_SUPPORTED

SQLSTATE: none assigned

Serverless compute is not enabled for this workspace.

For more details see SERVERLESS_NOT_SUPPORTED

TABLE_WITH_ROW_COLUMN_SECURITY_NOT_SUPPORTED_IN_ONLINE_MODE

Table <tableFullName> cannot have both row/column security and online materialized views.

TOO_MANY_ROWS_TO_UPDATE

Too many rows to update, aborting update.

UC_ABAC_UNSUPPORTED_TABLE_TYPE