Error conditions in Databricks

This is a list of common, named error conditions returned by Databricks.

Also see SQLSTATE codes.

Databricks Runtime and Databricks SQL

AI_INVALID_MODEL_ERROR

SQLSTATE: 22032

Provided artificial intelligence model is not supported <modelName>. Supported models are: <supportedModels>

ALTER_TABLE_COLUMN_DESCRIPTOR_DUPLICATE

SQLSTATE: 42710

ALTER TABLE <type> column <columnName> specifies descriptor “<optionName>” more than once, which is invalid.

AMBIGUOUS_COLUMN_OR_FIELD

SQLSTATE: 42702

Column or field <name> is ambiguous and has <n> matches.

AMBIGUOUS_CONSTRAINT

SQLSTATE: 42K0C

Ambiguous reference to constraint <constraint>.

AMBIGUOUS_LATERAL_COLUMN_ALIAS

SQLSTATE: 42702

Lateral column alias <name> is ambiguous and has <n> matches.

AMBIGUOUS_REFERENCE

SQLSTATE: 42704

Reference <name> is ambiguous, could be: <referenceNames>.

AMBIGUOUS_REFERENCE_TO_FIELDS

SQLSTATE: 42000

Ambiguous reference to the field <field>. It appears <count> times in the schema.

ARGUMENT_NOT_CONSTANT

SQLSTATE: 42K08

The function <functionName> includes a parameter <parameterName> at position <pos> that requires a constant argument. Please compute the argument <sqlExpr> separately and pass the result as a constant.

ARITHMETIC_OVERFLOW

SQLSTATE: 22003

<message>.<alternative> If necessary set <config> to “false” to bypass this error.

For more details see ARITHMETIC_OVERFLOW

BINARY_ARITHMETIC_OVERFLOW

SQLSTATE: 22003

<value1> <symbol> <value2> caused overflow.

BUILT_IN_CATALOG

SQLSTATE: 42832

<operation> doesn’t support built-in catalogs.

CANNOT_CAST_DATATYPE

SQLSTATE: 42846

Cannot cast <sourceType> to <targetType>.

CANNOT_CONSTRUCT_PROTOBUF_DESCRIPTOR

SQLSTATE: none assigned

Error constructing FileDescriptor for <descFilePath>.

CANNOT_CONVERT_PROTOBUF_FIELD_TYPE_TO_SQL_TYPE

SQLSTATE: none assigned

Cannot convert Protobuf <protobufColumn> to SQL <sqlColumn> because schema is incompatible (protobufType = <protobufType>, sqlType = <sqlType>).

CANNOT_CONVERT_PROTOBUF_MESSAGE_TYPE_TO_SQL_TYPE

SQLSTATE: none assigned

Unable to convert <protobufType> of Protobuf to SQL type <toType>.

CANNOT_CONVERT_SQL_TYPE_TO_PROTOBUF_ENUM_TYPE

SQLSTATE: none assigned

Cannot convert SQL <sqlColumn> to Protobuf <protobufColumn> because <data> cannot be written since it’s not defined in ENUM <enumString>.

CANNOT_CONVERT_SQL_TYPE_TO_PROTOBUF_FIELD_TYPE

SQLSTATE: none assigned

Cannot convert SQL <sqlColumn> to Protobuf <protobufColumn> because schema is incompatible (protobufType = <protobufType>, sqlType = <sqlType>).

CANNOT_COPY_STATE

SQLSTATE: 0AKD0

Cannot copy catalog state like current database and temporary views from Unity Catalog to a legacy catalog.

CANNOT_DECODE_URL

SQLSTATE: 22546

Cannot decode url : <url>.

CANNOT_DELETE_SYSTEM_OWNED

SQLSTATE: 42832

System owned <resourceType> cannot be deleted.

CANNOT_DROP_AMBIGUOUS_CONSTRAINT

SQLSTATE: 42K0C

Cannot drop the constraint with the name <constraintName> shared by a CHECK constraint

and a PRIMARY KEY or FOREIGN KEY constraint. You can drop the PRIMARY KEY or

FOREIGN KEY constraint by queries:

ALTER TABLE .. DROP PRIMARY KEY or

ALTER TABLE .. DROP FOREIGN KEY ..

CANNOT_LOAD_FUNCTION_CLASS

SQLSTATE: none assigned

Cannot load class <className> when registering the function <functionName>, please make sure it is on the classpath.

CANNOT_LOAD_PROTOBUF_CLASS

SQLSTATE: none assigned

Could not load Protobuf class with name <protobufClassName>. <explanation>.

CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE

SQLSTATE: 42825

Failed to merge incompatible data types <left> and <right>.

CANNOT_MODIFY_CONFIG

SQLSTATE: 46110

Cannot modify the value of the Spark config: <key>.

See also https://spark.apache.org/docs/latest/sql-migration-guide.html#ddl-statements’.

CANNOT_PARSE_DECIMAL

SQLSTATE: 22018

Cannot parse decimal.

CANNOT_PARSE_JSON_FIELD

SQLSTATE: 2203G

Cannot parse the field name <fieldName> and the value <fieldValue> of the JSON token type <jsonType> to target Spark data type <dataType>.

CANNOT_PARSE_PROTOBUF_DESCRIPTOR

SQLSTATE: none assigned

Error parsing file <descFilePath> descriptor byte[] into Descriptor object.

CANNOT_PARSE_TIMESTAMP

SQLSTATE: 22007

<message>. If necessary set <ansiConfig> to “false” to bypass this error.

CANNOT_READ_ARCHIVED_FILE

SQLSTATE: KD003

Cannot read file at path <path> because it has been archived. Please adjust your query filters to exclude archived files.

CANNOT_READ_FILE

SQLSTATE: KD003

Cannot read <format> file at path: <path>.

For more details see CANNOT_READ_FILE

CANNOT_READ_SENSITIVE_KEY_FROM_SECURE_PROVIDER

SQLSTATE: 42501

Cannot read sensitive key ‘<key>’ from secure provider.

CANNOT_RECOGNIZE_HIVE_TYPE

SQLSTATE: 429BB

Cannot recognize hive type string: <fieldType>, column: <fieldName>.

CANNOT_REFERENCE_UC_IN_HMS

SQLSTATE: 0AKD0

Cannot reference a Unity Catalog <objType> in Hive Metastore objects.

CANNOT_RENAME_ACROSS_CATALOG

SQLSTATE: 0AKD0

Renaming a <type> across catalogs is not allowed.

CANNOT_RENAME_ACROSS_METASTORE

SQLSTATE: 0AKD0

Renaming a table across metastore services is not allowed.

CANNOT_RENAME_ACROSS_SCHEMA

SQLSTATE: 0AKD0

Renaming a <type> across schemas is not allowed.

CANNOT_RESTORE_PERMISSIONS_FOR_PATH

SQLSTATE: none assigned

Failed to set permissions on created path <path> back to <permission>.

CANNOT_SHALLOW_CLONE_ACROSS_UC_AND_HMS

SQLSTATE: 0AKD0

Cannot shallow-clone tables across Unity Catalog and Hive Metastore.

CANNOT_SHALLOW_CLONE_NESTED

SQLSTATE: 0AKUC

Cannot shallow-clone a table <table> that is already a shallow clone.

CANNOT_SHALLOW_CLONE_NON_UC_MANAGED_TABLE_AS_SOURCE_OR_TARGET

SQLSTATE: 0AKUC

Shallow clone is only supported for the MANAGED table type. The table <table> is not MANAGED table.

CANNOT_UP_CAST_DATATYPE

SQLSTATE: none assigned

Cannot up cast <expression> from <sourceType> to <targetType>.

<details>

CAST_INVALID_INPUT

SQLSTATE: 22018

The value <expression> of the type <sourceType> cannot be cast to <targetType> because it is malformed. Correct the value as per the syntax, or change its target type. Use try_cast to tolerate malformed input and return NULL instead. If necessary set <ansiConfig> to “false” to bypass this error.

For more details see CAST_INVALID_INPUT

CAST_OVERFLOW

SQLSTATE: 22003

The value <value> of the type <sourceType> cannot be cast to <targetType> due to an overflow. Use try_cast to tolerate overflow and return NULL instead. If necessary set <ansiConfig> to “false” to bypass this error.

CAST_OVERFLOW_IN_TABLE_INSERT

SQLSTATE: 22003

Fail to insert a value of <sourceType> type into the <targetType> type column <columnName> due to an overflow. Use try_cast on the input value to tolerate overflow and return NULL instead.

CLOUD_FILE_SOURCE_FILE_NOT_FOUND

SQLSTATE: 42K03

A file notification was received for file: <filePath> but it does not exist anymore. Please ensure that files are not deleted before they are processed. To continue your stream, you can set the Spark SQL configuration <config> to true.

COLUMN_ALREADY_EXISTS

SQLSTATE: 42711

The column <columnName> already exists. Consider to choose another name or rename the existing column.

COLUMN_NOT_FOUND

SQLSTATE: 42703

The column <colName> cannot be found. Verify the spelling and correctness of the column name according to the SQL config <caseSensitiveConfig>.

COMPARATOR_RETURNS_NULL

SQLSTATE: none assigned

The comparator has returned a NULL for a comparison between <firstValue> and <secondValue>. It should return a positive integer for “greater than”, 0 for “equal” and a negative integer for “less than”. To revert to deprecated behavior where NULL is treated as 0 (equal), you must set “spark.sql.legacy.allowNullComparisonResultInArraySort” to “true”.

CONCURRENT_QUERY

SQLSTATE: none assigned

Another instance of this query [id: <queryId>] was just started by a concurrent session [existing runId: <existingQueryRunId> new runId: <newQueryRunId>].

CONNECT

SQLSTATE: none assigned

Generic Spark Connect error.

For more details see CONNECT

CONNECTION_ALREADY_EXISTS

SQLSTATE: 42000

Cannot create connection <connectionName> because it already exists.

Choose a different name, drop or replace the existing connection, or add the IF NOT EXISTS clause to tolerate pre-existing connections.

CONNECTION_NAME_CANNOT_BE_EMPTY

SQLSTATE: 42000

Cannot execute this command because the connection name must be non-empty.

CONNECTION_NOT_FOUND

SQLSTATE: 42000

Cannot execute this command because the connection name <connectionName> was not found.

CONNECTION_OPTION_NOT_SUPPORTED

SQLSTATE: 42000

Connections of type ‘<connectionType>’ do not support the following option(s): <optionsNotSupported>. Supported options: <allowedOptions>.

CONNECTION_TYPE_NOT_SUPPORTED

SQLSTATE: 42000

Cannot create connection of type ‘<connectionType>. Supported connection types: <allowedTypes>.

CONSTRAINTS_REQUIRE_UNITY_CATALOG

SQLSTATE: 0A000

Table constraints are only supported in Unity Catalog.

CONVERSION_INVALID_INPUT

SQLSTATE: 22018

The value <str> (<fmt>) cannot be converted to <targetType> because it is malformed. Correct the value as per the syntax, or change its format. Use <suggestion> to tolerate malformed input and return NULL instead.

COPY_INTO_CREDENTIALS_NOT_ALLOWED_ON

SQLSTATE: 0A000

Invalid scheme <scheme>. COPY INTO source encryption currently only supports s3/s3n/s3a/wasbs/abfss.

COPY_INTO_CREDENTIALS_REQUIRED

SQLSTATE: 42601

COPY INTO source credentials must specify <keyList>.

COPY_INTO_DUPLICATED_FILES_COPY_NOT_ALLOWED

SQLSTATE: 25000

Duplicated files were committed in a concurrent COPY INTO operation. Please try again later.

COPY_INTO_ENCRYPTION_NOT_ALLOWED_ON

SQLSTATE: 0A000

Invalid scheme <scheme>. COPY INTO source encryption currently only supports s3/s3n/s3a/abfss.

COPY_INTO_ENCRYPTION_NOT_SUPPORTED_FOR_AZURE

SQLSTATE: 0A000

COPY INTO encryption only supports ADLS Gen2, or abfss:// file scheme

COPY_INTO_ENCRYPTION_REQUIRED

SQLSTATE: 42601

COPY INTO source encryption must specify ‘<key>’.

COPY_INTO_ENCRYPTION_REQUIRED_WITH_EXPECTED

SQLSTATE: 42601

Invalid encryption option <requiredKey>. COPY INTO source encryption must specify ‘<requiredKey>’ = ‘<keyValue>’.

COPY_INTO_NON_BLIND_APPEND_NOT_ALLOWED

SQLSTATE: 25000

COPY INTO other than appending data is not allowed to run concurrently with other transactions. Please try again later.

COPY_INTO_ROCKSDB_MAX_RETRY_EXCEEDED

SQLSTATE: 25000

COPY INTO failed to load its state, maximum retries exceeded.

COPY_INTO_SOURCE_FILE_FORMAT_NOT_SUPPORTED

SQLSTATE: 0A000

The format of the source files must be one of CSV, JSON, AVRO, ORC, PARQUET, TEXT, or BINARYFILE. Using COPY INTO on Delta tables as the source is not supported as duplicate data may be ingested after OPTIMIZE operations. This check can be turned off by running the SQL command set spark.databricks.delta.copyInto.formatCheck.enabled = false.

COPY_INTO_SOURCE_SCHEMA_INFERENCE_FAILED

SQLSTATE: 42KD9

The source directory did not contain any parsable files of type <format>. Please check the contents of ‘<source>’.

CREATE_TABLE_COLUMN_DESCRIPTOR_DUPLICATE

SQLSTATE: 42710

CREATE TABLE column <columnName> specifies descriptor “<optionName>” more than once, which is invalid.

CREDENTIAL_MISSING

SQLSTATE: 42601

Please provide credentials when creating or updating external locations.

CYCLIC_FUNCTION_REFERENCE

SQLSTATE: 42887

Cyclic function reference detected: <path>.

DATABRICKS_DELTA_NOT_ENABLED

SQLSTATE: 56038

Databricks Delta is not enabled in your account.<hints>

DATATYPE_MISMATCH

SQLSTATE: 42K09

Cannot resolve <sqlExpr> due to data type mismatch:

For more details see DATATYPE_MISMATCH

DATATYPE_MISSING_SIZE

SQLSTATE: 42K01

DataType <type> requires a length parameter, for example <type>(10). Please specify the length.

DATA_SOURCE_NOT_FOUND

SQLSTATE: 42K02

Failed to find data source: <provider>. Please find packages at https://spark.apache.org/third-party-projects.html.

DATA_SOURCE_OPTION_CONTAINS_INVALID_CHARACTERS

SQLSTATE: 42602

Option <option> must not be empty and should not contain invalid characters, query strings, or parameters.

DATA_SOURCE_OPTION_IS_REQUIRED

SQLSTATE: 42601

Option <option> is required.

DATA_SOURCE_URL_NOT_ALLOWED

SQLSTATE: 42KDB

JDBC URL is not allowed in data source options, please specify ‘host’, ‘port’, and ‘database’ options instead.

DATETIME_OVERFLOW

SQLSTATE: 22008

Datetime operation overflow: <operation>.

DECIMAL_PRECISION_EXCEEDS_MAX_PRECISION

SQLSTATE: 22003

Decimal precision <precision> exceeds max precision <maxPrecision>.

DEFAULT_DATABASE_NOT_EXISTS

SQLSTATE: 42704

Default database <defaultDatabase> does not exist, please create it first or change default database to <defaultDatabase>.

DEFAULT_FILE_NOT_FOUND

SQLSTATE: 42K03

It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running ‘REFRESH TABLE tableName’ command in SQL or by recreating the Dataset/DataFrame involved. If Delta cache is stale or the underlying files have been removed, you can invalidate Delta cache manually by restarting the cluster.

DIVIDE_BY_ZERO

SQLSTATE: 22012

Division by zero. Use try_divide to tolerate divisor being 0 and return NULL instead. If necessary set <config> to “false” to bypass this error.

For more details see DIVIDE_BY_ZERO

DUPLICATED_MAP_KEY

SQLSTATE: 23505

Duplicate map key <key> was found, please check the input data. If you want to remove the duplicated keys, you can set <mapKeyDedupPolicy> to “LAST_WIN” so that the key inserted at last takes precedence.

DUPLICATE_KEY

SQLSTATE: 23505

Found duplicate keys <keyColumn>.

DUPLICATE_ROUTINE_PARAMETER_ASSIGNMENT

SQLSTATE: 4274K

The invocation of function <functionName> includes multiple arguments assigned to parameter <parameterName>. At most one argument can be assigned to each parameter.

DUPLICATE_ROUTINE_PARAMETER_NAMES

SQLSTATE: 42734

Found duplicate name(s) in the parameter list of the user-defined routine <routineName>: <names>.

DUPLICATE_ROUTINE_RETURNS_COLUMNS

SQLSTATE: 42711

Found duplicate column(s) in the RETURNS clause column list of the user-defined routine <routineName>: <columns>.

EMPTY_JSON_FIELD_VALUE

SQLSTATE: 42604

Failed to parse an empty string for data type <dataType>.

EMPTY_LOCAL_FILE_IN_STAGING_ACCESS_QUERY

SQLSTATE: 22023

Empty local file in staging <operation> query

ENCODER_NOT_FOUND

SQLSTATE: none assigned

Not found an encoder of the type <typeName> to Spark SQL internal representation. Consider to change the input type to one of supported athttps://spark.apache.org/docs/latest/sql-ref-datatypes.html.

EVENT_LOG_REQUIRES_SHARED_COMPUTE

SQLSTATE: 42601

Cannot query event logs from an Assigned or No Isolation Shared cluster, please use a Shared cluster or a Databricks SQL warehouse instead.

EVENT_LOG_UNAVAILABLE

SQLSTATE: 55019

No event logs available for <tableOrPipeline>. Please try again later after events are generated

EVENT_LOG_UNSUPPORTED_TABLE_TYPE

SQLSTATE: 42832

The table type of <tableIdentifier> is <tableType>.

Querying event logs only supports Materialized Views, Streaming Tables, or Delta Live Tables pipelines

EXCEPT_NESTED_COLUMN_INVALID_TYPE

SQLSTATE: 428H2

EXCEPT column <columnName> was resolved and expected to be StructType, but found type <dataType>.

EXCEPT_OVERLAPPING_COLUMNS

SQLSTATE: 42702

Columns in an EXCEPT list must be distinct and non-overlapping.

EXCEPT_RESOLVED_COLUMNS_WITHOUT_MATCH

SQLSTATE: 42703

EXCEPT columns [<exceptColumns>] were resolved, but do not match any of the columns [<expandedColumns>] from the star expansion.

EXCEPT_UNRESOLVED_COLUMN_IN_STRUCT_EXPANSION

SQLSTATE: 42703

The column/field name <objectName> in the EXCEPT clause cannot be resolved. Did you mean one of the following: [<objectList>]?

Note: nested columns in the EXCEPT clause may not include qualifiers (table name, parent struct column name, etc.) during a struct expansion; try removing qualifiers if they are used with nested columns.

EXTERNAL_TABLE_INVALID_SCHEME

SQLSTATE: 0A000

External tables don’t support the <scheme> scheme.

FAILED_EXECUTE_UDF

SQLSTATE: 39000

Failed to execute user defined function (<functionName>: (<signature>) => <result>).

FAILED_FUNCTION_CALL

SQLSTATE: 38000

Failed preparing of the function <funcName> for call. Please, double check function’s arguments.

FAILED_RENAME_PATH

SQLSTATE: 42K04

Failed to rename <sourcePath> to <targetPath> as destination already exists.

FEATURE_NOT_ON_CLASSIC_WAREHOUSE

SQLSTATE: 56038

<feature> is not supported on Classic SQL warehouses. To use this feature, use a Pro or Serverless SQL warehouse. To learn more about warehouse types, see <docLink>

FEATURE_REQUIRES_UC

SQLSTATE: 0AKUD

<feature> is not supported without Unity Catalog. To use this feature, enable Unity Catalog. To learn more about Unity Catalog, see <docLink>

FEATURE_UNAVAILABLE

SQLSTATE: 56038

<feature> is not supported in your environment. To use this feature, please contact Databricks Support.

FIELD_NOT_FOUND

SQLSTATE: 42704

No such struct field <fieldName> in <fields>.

FILE_IN_STAGING_PATH_ALREADY_EXISTS

SQLSTATE: 42K04

File in staging path <path> already exists but OVERWRITE is not set

FORBIDDEN_OPERATION

SQLSTATE: 42809

The operation <statement> is not allowed on the <objectType>: <objectName>.

FOREIGN_KEY_MISMATCH

SQLSTATE: 42830

Foreign key parent columns <parentColumns> do not match primary key child columns <childColumns>.

FOREIGN_OBJECT_NAME_CANNOT_BE_EMPTY

SQLSTATE: 42000

Cannot execute this command because the foreign <objectType> name must be non-empty.

GENERATED_COLUMN_WITH_DEFAULT_VALUE

SQLSTATE: none assigned

A column cannot have both a default value and a generation expression but column <colName> has default value: (<defaultValue>) and generation expression: (<genExpr>).

GRAPHITE_SINK_INVALID_PROTOCOL

SQLSTATE: none assigned

Invalid Graphite protocol: <protocol>.

GRAPHITE_SINK_PROPERTY_MISSING

SQLSTATE: none assigned

Graphite sink requires ‘<property>’ property.

GROUPING_COLUMN_MISMATCH

SQLSTATE: 42803

Column of grouping (<grouping>) can’t be found in grouping columns <groupingColumns>.

GROUPING_ID_COLUMN_MISMATCH

SQLSTATE: 42803

Columns of grouping_id (<groupingIdColumn>) does not match grouping columns (<groupByColumns>).

GROUPING_SIZE_LIMIT_EXCEEDED

SQLSTATE: 54000

Grouping sets size cannot be greater than <maxSize>.

GROUP_BY_AGGREGATE

SQLSTATE: 42903

Aggregate functions are not allowed in GROUP BY, but found <sqlExpr>.

For more details see GROUP_BY_AGGREGATE

GROUP_BY_POS_AGGREGATE

SQLSTATE: 42903

GROUP BY <index> refers to an expression <aggExpr> that contains an aggregate function. Aggregate functions are not allowed in GROUP BY.

GROUP_BY_POS_OUT_OF_RANGE

SQLSTATE: 42805

GROUP BY position <index> is not in select list (valid range is [1, <size>]).

IDENTIFIER_TOO_MANY_NAME_PARTS

SQLSTATE: 42601

<identifier> is not a valid identifier as it has more than 2 name parts.

INCOMPARABLE_PIVOT_COLUMN

SQLSTATE: 42818

Invalid pivot column <columnName>. Pivot columns must be comparable.

INCOMPATIBLE_COLUMN_TYPE

SQLSTATE: 42825

<operator> can only be performed on tables with compatible column types. The <columnOrdinalNumber> column of the <tableOrdinalNumber> table is <dataType1> type which is not compatible with <dataType2> at the same column of the first table.<hint>.

INCOMPATIBLE_DATASOURCE_REGISTER

SQLSTATE: none assigned

Detected an incompatible DataSourceRegister. Please remove the incompatible library from classpath or upgrade it. Error: <message>

INCOMPATIBLE_JOIN_TYPES

SQLSTATE: 42613

The join types <joinType1> and <joinType2> are incompatible.

INCOMPATIBLE_VIEW_SCHEMA_CHANGE

SQLSTATE: none assigned

The SQL query of view <viewName> has an incompatible schema change and column <colName> cannot be resolved. Expected <expectedNum> columns named <colName> but got <actualCols>.

Please try to re-create the view by running: <suggestion>.

INCOMPLETE_TYPE_DEFINITION

SQLSTATE: 42K01

Incomplete complex type:

For more details see INCOMPLETE_TYPE_DEFINITION

INCONSISTENT_BEHAVIOR_CROSS_VERSION

SQLSTATE: 42K0B

You may get a different result due to the upgrading to

For more details see INCONSISTENT_BEHAVIOR_CROSS_VERSION

INCORRECT_END_OFFSET

SQLSTATE: 22003

Max offset with <rowsPerSecond> rowsPerSecond is <maxSeconds>, but it’s <endSeconds> now.

INCORRECT_NUMBER_OF_ARGUMENTS

SQLSTATE: 42605

<failure>, <functionName> requires at least <minArgs> arguments and at most <maxArgs> arguments.

INCORRECT_RAMP_UP_RATE

SQLSTATE: 22003

Max offset with <rowsPerSecond> rowsPerSecond is <maxSeconds>, but ‘rampUpTimeSeconds’ is <rampUpTimeSeconds>.

INDEX_ALREADY_EXISTS

SQLSTATE: 42710

Cannot create the index <indexName> on table <tableName> because it already exists.

INDEX_NOT_FOUND

SQLSTATE: 42704

Cannot find the index <indexName> on table <tableName>.

INSUFFICIENT_PERMISSIONS

SQLSTATE: 42501

Insufficient privileges:

<report>

INSUFFICIENT_PERMISSIONS_EXT_LOC

SQLSTATE: 42501

User <user> has insufficient privileges for external location <location>.

INSUFFICIENT_PERMISSIONS_NO_OWNER

SQLSTATE: 42501

There is no owner for <securableName>. Ask your administrator to set an owner.

INSUFFICIENT_PERMISSIONS_OWNERSHIP_SECURABLE

SQLSTATE: 42501

User does not own <securableName>.

INSUFFICIENT_PERMISSIONS_SECURABLE

SQLSTATE: 42501

User does not have permission <action> on <securableName>.

INSUFFICIENT_PERMISSIONS_SECURABLE_PARENT_OWNER

SQLSTATE: 42501

The owner of <securableName> is different from the owner of <parentSecurableName>.

INSUFFICIENT_PERMISSIONS_STORAGE_CRED

SQLSTATE: 42501

Storage credential <credentialName> has insufficient privileges.

INSUFFICIENT_PERMISSIONS_UNDERLYING_SECURABLES

SQLSTATE: 42501

User cannot <action> on <securableName> because of permissions on underlying securables.

INSUFFICIENT_PERMISSIONS_UNDERLYING_SECURABLES_VERBOSE

SQLSTATE: 42501

User cannot <action> on <securableName> because of permissions on underlying securables:

<underlyingReport>

INTERNAL_ERROR

SQLSTATE: XX000

<message>

INTERVAL_ARITHMETIC_OVERFLOW

SQLSTATE: 22015

<message>.<alternative>

INTERVAL_DIVIDED_BY_ZERO

SQLSTATE: 22012

Division by zero. Use try_divide to tolerate divisor being 0 and return NULL instead.

INVALID_ARRAY_INDEX

SQLSTATE: 22003

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use the SQL function get() to tolerate accessing element at invalid index and return NULL instead. If necessary set <ansiConfig> to “false” to bypass this error.

For more details see INVALID_ARRAY_INDEX

INVALID_ARRAY_INDEX_IN_ELEMENT_AT

SQLSTATE: 22003

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use try_element_at to tolerate accessing element at invalid index and return NULL instead. If necessary set <ansiConfig> to “false” to bypass this error.

For more details see INVALID_ARRAY_INDEX_IN_ELEMENT_AT

INVALID_BUCKET_FILE

SQLSTATE: none assigned

Invalid bucket file: <path>.

INVALID_BYTE_STRING

SQLSTATE: none assigned

The expected format is ByteString, but was <unsupported> (<class>).

INVALID_COLUMN_NAME_AS_PATH

SQLSTATE: 46121

The datasource <datasource> cannot save the column <columnName> because its name contains some characters that are not allowed in file paths. Please, use an alias to rename it.

INVALID_COLUMN_OR_FIELD_DATA_TYPE

SQLSTATE: 42000

Column or field <name> is of type <type> while it’s required to be <expectedType>.

INVALID_DEST_CATALOG

SQLSTATE: 42809

Destination catalog of the SYNC command must be within Unity Catalog. Found <catalog>.

INVALID_EMPTY_LOCATION

SQLSTATE: 42K05

The location name cannot be empty string, but <location> was given.

INVALID_EXTRACT_BASE_FIELD_TYPE

SQLSTATE: 42000

Can’t extract a value from <base>. Need a complex type [STRUCT, ARRAY, MAP] but got <other>.

INVALID_EXTRACT_FIELD

SQLSTATE: 42601

Cannot extract <field> from <expr>.

INVALID_EXTRACT_FIELD_TYPE

SQLSTATE: 42000

Field name should be a non-null string literal, but it’s <extraction>.

INVALID_FIELD_NAME

SQLSTATE: 42000

Field name <fieldName> is invalid: <path> is not a struct.

INVALID_FORMAT

SQLSTATE: 42601

The format is invalid: <format>.

For more details see INVALID_FORMAT

INVALID_FRACTION_OF_SECOND

SQLSTATE: 22023

The fraction of sec must be zero. Valid range is [0, 60]. If necessary set <ansiConfig> to “false” to bypass this error.

INVALID_IDENTIFIER

SQLSTATE: 42602

The identifier <ident> is invalid. Please, consider quoting it with back-quotes as <ident>.

INVALID_INDEX_OF_ZERO

SQLSTATE: 22003

The index 0 is invalid. An index shall be either < 0 or > 0 (the first element has index 1).

INVALID_JSON_ROOT_FIELD

SQLSTATE: 22032

Cannot convert JSON root field to target Spark type.

INVALID_JSON_SCHEMA_MAP_TYPE

SQLSTATE: 22032

Input schema <jsonSchema> can only contain STRING as a key type for a MAP.

INVALID_LATERAL_JOIN_TYPE

SQLSTATE: 42613

The <joinType> JOIN with LATERAL correlation is not allowed because an OUTER subquery cannot correlate to its join partner. Remove the LATERAL correlation or use an INNER JOIN, or LEFT OUTER JOIN instead.

INVALID_OPTIONS

SQLSTATE: 42K06

Invalid options:

For more details see INVALID_OPTIONS

INVALID_PANDAS_UDF_PLACEMENT

SQLSTATE: 0A000

The group aggregate pandas UDF <functionList> cannot be invoked together with as other, non-pandas aggregate functions.

INVALID_PARAMETER_VALUE

SQLSTATE: 22023

The value of parameter(s) <parameter> in <functionName> is invalid:

For more details see INVALID_PARAMETER_VALUE

INVALID_PIPELINE_ID

SQLSTATE: 42604

Pipeline id <pipelineId> is not valid.

A pipeline id should be a UUID in the format of ‘xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx’

INVALID_PRIVILEGE

SQLSTATE: 42852

Privilege <privilege> is not valid for <securable>.

INVALID_PROPERTY_KEY

SQLSTATE: 42602

<key> is an invalid property key, please use quotes, e.g. SET <key>=<value>.

INVALID_PROPERTY_VALUE

SQLSTATE: 42602

<value> is an invalid property value, please use quotes, e.g. SET <key>=<value>

INVALID_S3_COPY_CREDENTIALS

SQLSTATE: 42501

COPY INTO credentials must include AWS_ACCESS_KEY, AWS_SECRET_KEY, and AWS_SESSION_TOKEN.

INVALID_SCHEMA

SQLSTATE: 42K07

The input schema <inputSchema> is not a valid schema string.

For more details see INVALID_SCHEMA

INVALID_SCHEME

SQLSTATE: 0AKUC

Unity catalog does not support <name> as the default file scheme.

INVALID_SECRET_LOOKUP

SQLSTATE: 22531

Invalid secret lookup:

For more details see INVALID_SECRET_LOOKUP

INVALID_SET_SYNTAX

SQLSTATE: 42000

Expected format is ‘SET’, ‘SET key’, or ‘SET key=value’. If you want to include special characters in key, or include semicolon in value, please use backquotes, e.g., SET key=value.

INVALID_SOURCE_CATALOG

SQLSTATE: 42809

Source catalog must not be within Unity Catalog for the SYNC command. Found <catalog>.

INVALID_SQL_ARG

SQLSTATE: none assigned

The argument <name> of sql() is invalid. Consider to replace it by a SQL literal.

INVALID_SQL_FUNCTION_PLAN_STRUCTURE

SQLSTATE: XXKD0

Invalid SQL function plan structure

<plan>

INVALID_SQL_SYNTAX

SQLSTATE: 42000

Invalid SQL syntax: <inputString>.

INVALID_STAGING_PATH_IN_STAGING_ACCESS_QUERY

SQLSTATE: 42604

Invalid staging path in staging <operation> query: <path>

INVALID_TEMP_OBJ_REFERENCE

SQLSTATE: none assigned

Cannot create the persistent object <objName> of the type <obj> because it references to the temporary object <tempObjName> of the type <tempObj>. Please make the temporary object <tempObjName> persistent, or make the persistent object <objName> temporary.

INVALID_TIMESTAMP_FORMAT

SQLSTATE: 22000

The provided timestamp <timestamp> doesn’t match the expected syntax <format>.

INVALID_TYPED_LITERAL

SQLSTATE: 42604

The value of the typed literal <valueType> is invalid: <value>.

INVALID_UPGRADE_SYNTAX

SQLSTATE: 42809

<command> <supportedOrNot> the source table is in Hive Metastore and the destination table is in Unity Catalog.

INVALID_URL

SQLSTATE: none assigned

The url is invalid: <url>. If necessary set <ansiConfig> to “false” to bypass this error.

INVALID_UUID

SQLSTATE: 42604

Input <uuidInput> is not a valid UUID.

The UUID should be in the format of ‘xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx’

Please check the format of the UUID.

INVALID_WHERE_CONDITION

SQLSTATE: 42903

The WHERE condition <condition> contains invalid expressions: <expressionList>.

Rewrite the query to avoid window functions, aggregate functions, and generator functions in the WHERE clause.

INVALID_WRITE_DISTRIBUTION

SQLSTATE: none assigned

The requested write distribution is invalid.

For more details see INVALID_WRITE_DISTRIBUTION

LOCATION_ALREADY_EXISTS

SQLSTATE: 42710

Cannot name the managed table as <identifier>, as its associated location <location> already exists. Please pick a different table name, or remove the existing location first.

MALFORMED_CSV_RECORD

SQLSTATE: none assigned

Malformed CSV record: <badRecord>

MALFORMED_PROTOBUF_MESSAGE

SQLSTATE: none assigned

Malformed Protobuf messages are detected in message deserialization. Parse Mode: <failFastMode>. To process malformed protobuf message as null result, try setting the option ‘mode’ as ‘PERMISSIVE’.

MALFORMED_RECORD_IN_PARSING

SQLSTATE: none assigned

Malformed records are detected in record parsing: <badRecord>.

Parse Mode: <failFastMode>. To process malformed records as null result, try setting the option ‘mode’ as ‘PERMISSIVE’.

MANAGED_TABLE_WITH_CRED

SQLSTATE: 42613

Create managed table with storage credential is not supported.

MATERIALIZED_VIEW_MESA_REFRESH_WITHOUT_PIPELINE_ID

SQLSTATE: 55019

Cannot <refreshType> the materialized view because it predates having a pipelineId. To enable <refreshType> please drop and recreate the materialized view.

MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED

SQLSTATE: 56038

The materialized view operation <operation> is not allowed:

For more details see MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED

MATERIALIZED_VIEW_OUTPUT_WITHOUT_EXPLICIT_ALIAS

SQLSTATE: none assigned

Output expression <expression> in a materialized view must be explicitly aliased.

MISSING_AGGREGATION

SQLSTATE: 42803

The non-aggregating expression <expression> is based on columns which are not participating in the GROUP BY clause.

Add the columns or the expression to the GROUP BY, aggregate the expression, or use <expressionAnyValue> if you do not care which of the values within a group is returned.

For more details see MISSING_AGGREGATION

MISSING_CONNECTION_OPTION

SQLSTATE: 42000

Connections of type ‘<connectionType>’ must include the following option(s): <requiredOptions>.

MISSING_GROUP_BY

SQLSTATE: 42803

The query does not include a GROUP BY clause. Add GROUP BY or turn it into the window functions using OVER clauses.

MISSING_NAME_FOR_CHECK_CONSTRAINT

SQLSTATE: 42000

CHECK constraint must have a name.

MISSING_PARAMETER_FOR_KAFKA

SQLSTATE: none assigned

Parameter <parameterName> is required for Kafka, but is not specified in <functionName>.

MISSING_TABLE_NAME_AND_ID_TO_UNDROP

SQLSTATE: none assigned

Please provide either table name using UNDROP TABLE table_name,

or table ID using UNDROP TABLE WITH ‘table_uuid’

MODIFY_BUILTIN_CATALOG

SQLSTATE: 42832

Modifying built-in catalog <catalogName> is not supported.

MULTIPLE_LOAD_PATH

SQLSTATE: 42000

Databricks Delta does not support multiple input paths in the load() API.

paths: <pathList>. To build a single DataFrame by loading

multiple paths from the same Delta table, please load the root path of

the Delta table with the corresponding partition filters. If the multiple paths

are from different Delta tables, please use Dataset’s union()/unionByName() APIs

to combine the DataFrames generated by separate load() API calls.

MULTIPLE_MATCHING_CONSTRAINTS

SQLSTATE: 42891

Found at least two matching constraints with the given condition.

MULTI_UDF_INTERFACE_ERROR

SQLSTATE: none assigned

Not allowed to implement multiple UDF interfaces, UDF class <className>.

NAMESPACE_ALREADY_EXISTS

SQLSTATE: 42000

Cannot create namespace <nameSpaceName> because it already exists.

Choose a different name, drop the existing namespace, or add the IF NOT EXISTS clause to tolerate pre-existing namespace.

NAMESPACE_NOT_EMPTY

SQLSTATE: 42000

Cannot drop a namespace <nameSpaceNameName> because it contains objects.

Use DROP NAMESPACE … CASCADE to drop the namespace and all its objects.

NAMESPACE_NOT_FOUND

SQLSTATE: 42000

The namespace <nameSpaceName> cannot be found. Verify the spelling and correctness of the namespace.

If you did not qualify the name with, verify the current_schema() output, or qualify the name with the correctly.

To tolerate the error on drop use DROP NAMESPACE IF EXISTS.

NESTED_AGGREGATE_FUNCTION

SQLSTATE: 42607

It is not allowed to use an aggregate function in the argument of another aggregate function. Please use the inner aggregate function in a sub-query.

NON_LAST_MATCHED_CLAUSE_OMIT_CONDITION

SQLSTATE: 42613

When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.

NON_LAST_NOT_MATCHED_BY_SOURCE_CLAUSE_OMIT_CONDITION

SQLSTATE: 42613

When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.

NON_LAST_NOT_MATCHED_CLAUSE_OMIT_CONDITION

SQLSTATE: 42613

When there are more than one NOT MATCHED clauses in a MERGE statement, only the last NOT MATCHED clause can omit the condition.

NON_LITERAL_PIVOT_VALUES

SQLSTATE: 42K08

Literal expressions required for pivot values, found <expression>.

NON_PARTITION_COLUMN

SQLSTATE: 42000

PARTITION clause cannot contain the non-partition column: <columnName>.

NOT_A_PARTITIONED_TABLE

SQLSTATE: none assigned

Operation <operation> is not allowed for <tableIdentWithDB> because it is not a partitioned table.

NOT_A_SCALAR_FUNCTION

SQLSTATE: 42887

<functionName> appears as a scalar expression here, but the function was defined as a table function. Please update the query to move the function call into the FROM clause, or redefine <functionName> as a scalar function instead.

NOT_A_TABLE_FUNCTION

SQLSTATE: 42887

<functionName> appears as a table function here, but the function was defined as a scalar function. Please update the query to move the function call outside the FROM clause, or redefine <functionName> as a table function instead.

NOT_NULL_CONSTRAINT_VIOLATION

SQLSTATE: 42000

Assigning a NULL is not allowed here.

For more details see NOT_NULL_CONSTRAINT_VIOLATION

NOT_SUPPORTED_WITH_DB_SQL

SQLSTATE: 0A000

<operation> is not supported on a SQL <endpoint>.

NO_HANDLER_FOR_UDAF

SQLSTATE: none assigned

No handler for UDAF ‘<functionName>’. Use sparkSession.udf.register(…) instead.

NO_SQL_TYPE_IN_PROTOBUF_SCHEMA

SQLSTATE: none assigned

Cannot find <catalystFieldPath> in Protobuf schema.

NO_UDF_INTERFACE

SQLSTATE: none assigned

UDF class <className> doesn’t implement any UDF interface.

NULLABLE_COLUMN_OR_FIELD

SQLSTATE: 42000

Column or field <name> is nullable while it’s required to be non-nullable.

NULLABLE_ROW_ID_ATTRIBUTES

SQLSTATE: 42000

Row ID attributes cannot be nullable: <nullableRowIdAttrs>.

NULL_MAP_KEY

SQLSTATE: 2200E

Cannot use null as map key.

NUMERIC_OUT_OF_SUPPORTED_RANGE

SQLSTATE: 22003

The value <value> cannot be interpreted as a numeric since it has more than 38 digits.

NUMERIC_VALUE_OUT_OF_RANGE

SQLSTATE: 22003

<value> cannot be represented as Decimal(<precision>, <scale>). If necessary set <config> to “false” to bypass this error, and return NULL instead.

NUM_COLUMNS_MISMATCH

SQLSTATE: 42826

<operator> can only be performed on inputs with the same number of columns, but the first input has <firstNumColumns> columns and the <invalidOrdinalNum> input has <invalidNumColumns> columns.

OAUTH_CUSTOM_IDENTITY_CLAIM_NOT_PROVIDED

SQLSTATE: 22KD2

No custom identity claim was provided.

ONLY_SECRET_FUNCTION_SUPPORTED_HERE

SQLSTATE: none assigned

Calling function <functionName> is not supported in this <location>; <supportedFunctions> supported here.

OPERATION_REQUIRES_UNITY_CATALOG

SQLSTATE: 0AKUD

Operation <operation> requires Unity Catalog enabled.

OP_NOT_SUPPORTED_READ_ONLY

SQLSTATE: 42KD1

<plan> is not supported in read-only session mode.

ORDER_BY_POS_OUT_OF_RANGE

SQLSTATE: 42805

ORDER BY position <index> is not in select list (valid range is [1, <size>]).

PARSE_EMPTY_STATEMENT

SQLSTATE: 42617

Syntax error, unexpected empty statement.

PARSE_SYNTAX_ERROR

SQLSTATE: 42601

Syntax error at or near <error>``<hint>.

PARTITIONS_ALREADY_EXIST

SQLSTATE: 428FT

Cannot ADD or RENAME TO partition(s) <partitionList> in table <tableName> because they already exist.

Choose a different name, drop the existing partition, or add the IF NOT EXISTS clause to tolerate a pre-existing partition.

PARTITIONS_NOT_FOUND

SQLSTATE: 428FT

The partition(s) <partitionList> cannot be found in table <tableName>.

Verify the partition specification and table name.

To tolerate the error on drop use ALTER TABLE … DROP IF EXISTS PARTITION.

PARTITION_METADATA

SQLSTATE: 0AKUC

<action> is not allowed on table <tableName> since storing partition metadata is not supported in Unity Catalog.

PATH_ALREADY_EXISTS

SQLSTATE: 42K04

Path <outputPath> already exists. Set mode as “overwrite” to overwrite the existing path.

PATH_NOT_FOUND

SQLSTATE: 42K03

Path does not exist: <path>.

PIVOT_VALUE_DATA_TYPE_MISMATCH

SQLSTATE: 42K09

Invalid pivot value ‘<value>’: value data type <valueType> does not match pivot column data type <pivotType>.

PLAN_VALIDATION_FAILED_RULE_EXECUTOR

SQLSTATE: none assigned

The input plan of <ruleExecutor> is invalid: <reason>

PLAN_VALIDATION_FAILED_RULE_IN_BATCH

SQLSTATE: none assigned

Rule <rule> in batch <batch> generated an invalid plan: <reason>

PROTOBUF_DEPENDENCY_NOT_FOUND

SQLSTATE: none assigned

Could not find dependency: <dependencyName>.

PROTOBUF_DESCRIPTOR_FILE_NOT_FOUND

SQLSTATE: none assigned

Error reading Protobuf descriptor file at path: <filePath>.

PROTOBUF_FIELD_MISSING

SQLSTATE: none assigned

Searching for <field> in Protobuf schema at <protobufSchema> gave <matchSize> matches. Candidates: <matches>.

PROTOBUF_FIELD_MISSING_IN_SQL_SCHEMA

SQLSTATE: none assigned

Found <field> in Protobuf schema but there is no match in the SQL schema.

PROTOBUF_FIELD_TYPE_MISMATCH

SQLSTATE: none assigned

Type mismatch encountered for field: <field>.

PROTOBUF_JAVA_CLASSES_NOT_SUPPORTED

SQLSTATE: none assigned

Java classes are not supported for <protobufFunction>. Contact Databricks Support about alternate options.

PROTOBUF_MESSAGE_NOT_FOUND

SQLSTATE: none assigned

Unable to locate Message <messageName> in Descriptor.

PROTOBUF_TYPE_NOT_SUPPORT

SQLSTATE: none assigned

Protobuf type not yet supported: <protobufType>.

QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_OR_COLUMN_ACCESS_POLICY

SQLSTATE: none assigned

Unable to access referenced table because a previously assigned row filter or column mask is currently incompatible with the table schema; to continue, please contact the owner of the table to update the policy:

For more details see QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_OR_COLUMN_ACCESS_POLICY

QUERY_RESULT_PARSE_AS_ARROW_FAILED

SQLSTATE: XX000

An internal error occurred while parsing the result as an Arrow dataset.

QUERY_RESULT_READ_FROM_CLOUD_STORE_FAILED

SQLSTATE: XX000

An internal error occurred while downloading the result set from the cloud store.

QUERY_RESULT_WRITE_TO_CLOUD_STORE_FAILED

SQLSTATE: XX000

An internal error occurred while uploading the result set to the cloud store.

QUERY_STREAMING_TABLE_FROM_CLASSIC_SQL_WAREHOUSE

SQLSTATE: 56038

Cannot query Streaming Table <tableName> from a Classic SQL Warehouse, please upgrade or use a Pro or Serverless Warehouse.

READ_FILES_AMBIGUOUS_ROUTINE_PARAMETERS

SQLSTATE: 4274K

The invocation of function <functionName> has <parameterName> and <alternativeName> set, which are aliases of each other. Please set only one of them.

READ_TVF_UNEXPECTED_REQUIRED_PARAMETER

SQLSTATE: 4274K

The function <functionName> required parameter <parameterName> must be assigned at position <expectedPos> without the name.

RECURSIVE_PROTOBUF_SCHEMA

SQLSTATE: none assigned

Found recursive reference in Protobuf schema, which can not be processed by Spark by default: <fieldDescriptor>. try setting the option recursive.fields.max.depth 0 to 10. Going beyond 10 levels of recursion is not allowed.

RELATION_LARGER_THAN_8G

SQLSTATE: none assigned

Can not build a <relationName> that is larger than 8G.

REMOTE_FUNCTION_HTTP_FAILED_ERROR

SQLSTATE: 57012

The remote HTTP request failed with code <errorCode>, and error message <errorMessage>

REMOTE_FUNCTION_HTTP_RESULT_PARSE_ERROR

SQLSTATE: 22032

Could not parse the JSON result from the remote HTTP response; the error message is <errorMessage>

REMOTE_FUNCTION_HTTP_RETRY_TIMEOUT

SQLSTATE: 57012

The remote request failed after retrying <N> times; the last failed HTTP error code was <errorCode> and the message was <errorMessage>

RENAME_SRC_PATH_NOT_FOUND

SQLSTATE: 42K03

Failed to rename as <sourcePath> was not found.

REPEATED_CLAUSE

SQLSTATE: 42614

The <clause> clause may be used at most once per <operation> operation.

REQUIRED_PARAMETER_NOT_FOUND

SQLSTATE: 4274K

The function <functionName> required parameter <parameterName> at position <pos> not found, please provide it positionally, not by name.

REQUIRES_SINGLE_PART_NAMESPACE

SQLSTATE: 42K05

<sessionCatalog> requires a single-part namespace, but got <namespace>.

RESERVED_CDC_COLUMNS_ON_WRITE

SQLSTATE: 42939

The write contains reserved columns <columnList> that are used

internally as metadata for Change Data Feed. To write to the table either rename/drop

these columns or disable Change Data Feed on the table by setting

<config> to false.

ROUTINE_ALREADY_EXISTS

SQLSTATE: 42723

Cannot create the function <routineName> because it already exists.

Choose a different name, drop or replace the existing function, or add the IF NOT EXISTS clause to tolerate a pre-existing function.

ROUTINE_NOT_FOUND

SQLSTATE: 42883

The function <routineName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP FUNCTION IF EXISTS.

ROUTINE_PARAMETER_NOT_FOUND

SQLSTATE: 42000

The function <functionName> does not support the parameter <parameterName> specified at position <pos>.<suggestion>

ROUTINE_USES_SYSTEM_RESERVED_CLASS_NAME

SQLSTATE: 42939

The function <routineName> cannot be created because the specified classname ‘<className>’ is reserved for system use. Please rename the class and try again.

ROW_COLUMN_ACCESS

SQLSTATE: none assigned

Error using row filters or column masks:

For more details see ROW_COLUMN_ACCESS

SAMPLE_TABLE_PERMISSIONS

SQLSTATE: 42832

Permissions not supported on sample databases/tables.

SCALAR_SUBQUERY_TOO_MANY_ROWS

SQLSTATE: 21000

More than one row returned by a subquery used as an expression.

SCHEMA_ALREADY_EXISTS

SQLSTATE: 42P06

Cannot create schema <schemaName> because it already exists.

Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema.

SCHEMA_NOT_EMPTY

SQLSTATE: 2BP01

Cannot drop a schema <schemaName> because it contains objects.

Use DROP SCHEMA … CASCADE to drop the schema and all its objects.

SCHEMA_NOT_FOUND

SQLSTATE: 42704

The schema <schemaName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a catalog, verify the current_schema() output, or qualify the name with the correct catalog.

To tolerate the error on drop use DROP SCHEMA IF EXISTS.

SCHEMA_REGISTRY_CONFIGURATION_ERROR

SQLSTATE: none assigned

Schema from schema registry could not be initialized. <reason>.

SECOND_FUNCTION_ARGUMENT_NOT_INTEGER

SQLSTATE: 22023

The second argument of <functionName> function needs to be an integer.

SECRET_FUNCTION_INVALID_LOCATION

SQLSTATE: none assigned

Cannot execute <commandType> command with one or more non-encrypted references to the SECRET function; please encrypt the result of each such function call with AES_ENCRYPT and try the command again

SORT_BY_WITHOUT_BUCKETING

SQLSTATE: none assigned

sortBy must be used together with bucketBy.

SQL_CONF_NOT_FOUND

SQLSTATE: none assigned

The SQL config <sqlConf> cannot be found. Please verify that the config exists.

STAGING_PATH_CURRENTLY_INACCESSIBLE

SQLSTATE: 22000

Transient error while accessing target staging path <path>, please try in a few minutes

STAR_GROUP_BY_POS

SQLSTATE: 0A000

Star (*) is not allowed in a select list when GROUP BY an ordinal position is used.

STATIC_PARTITION_COLUMN_IN_INSERT_COLUMN_LIST

SQLSTATE: none assigned

Static partition column <staticName> is also specified in the column list.

STREAMING_FROM_MATERIALIZED_VIEW

SQLSTATE: none assigned

Cannot stream from Materialized View <viewName>. Streaming from Materialized Views is not supported.

STREAMING_TABLE_NEEDS_REFRESH

SQLSTATE: 55019

Streaming table <tableName> needs to be refreshed. Please run CREATE OR REFRESH STREAMING TABLE <tableName> or REFRESH STREAMING TABLE <tableName> to update the table.

STREAMING_TABLE_NOT_SUPPORTED

SQLSTATE: 56038

Streaming Tables can only be created and refreshed in Delta Live Tables and Databricks SQL Warehouses.

STREAMING_TABLE_OPERATION_INTERNAL_ERROR

SQLSTATE: XX000

Internal error during operation <operation> on Streaming Table: Please file a bug report.

STREAMING_TABLE_OPERATION_NOT_ALLOWED

SQLSTATE: 42601

The operation <operation> is not allowed:

For more details see STREAMING_TABLE_OPERATION_NOT_ALLOWED

STREAMING_TABLE_QUERY_INVALID

SQLSTATE: 42000

Streaming table <tableName> can only be created from a streaming query. Please add the STREAM keyword to your FROM clause to turn this relation into a streaming query.

STREAM_FAILED

SQLSTATE: none assigned

Query [id = <id>, runId = <runId>] terminated with exception: <message>

SYNC_METADATA_DELTA_ONLY

SQLSTATE: 0AKDD

Repair table sync metadata command is only supported for delta table.

SYNC_METADATA_NOT_SUPPORTED

SQLSTATE: 0AKUD

Repair table sync metadata command is only supported for Unity Catalog tables.

SYNC_SRC_TARGET_TBL_NOT_SAME

SQLSTATE: 42KD2

Source table name <srcTable> must be same as destination table name <destTable>.

TABLE_OR_VIEW_ALREADY_EXISTS

SQLSTATE: 42P07

Cannot create table or view <relationName> because it already exists.

Choose a different name, drop or replace the existing object, add the IF NOT EXISTS clause to tolerate pre-existing objects, or add the OR REFRESH clause to refresh the existing streaming table.

TABLE_OR_VIEW_NOT_FOUND

SQLSTATE: 42P01

The table or view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.

For more details see TABLE_OR_VIEW_NOT_FOUND

TABLE_WITH_ID_NOT_FOUND

SQLSTATE: 42P01

Table with ID <tableId> cannot be found. Verify the correctness of the UUID.

TASK_WRITE_FAILED

SQLSTATE: none assigned

Task failed while writing rows to <path>.

TEMP_TABLE_OR_VIEW_ALREADY_EXISTS

SQLSTATE: 42P07

Cannot create the temporary view <relationName> because it already exists.

Choose a different name, drop or replace the existing view, or add the IF NOT EXISTS clause to tolerate pre-existing views.

TEMP_VIEW_NAME_TOO_MANY_NAME_PARTS

SQLSTATE: 428EK

CREATE TEMPORARY VIEW or the corresponding Dataset APIs only accept single-part view names, but got: <actualName>.

TOO_MANY_ARRAY_ELEMENTS

SQLSTATE: 54000

Cannot initialize array with <numElements> elements of size <size>.

UC_BUCKETED_TABLES

SQLSTATE: 0AKUC

Bucketed tables are not supported in Unity Catalog.

UC_CATALOG_NAME_NOT_PROVIDED

SQLSTATE: 3D000

For Unity Catalog, please specify the catalog name explicitly. E.g. SHOW GRANT your.address@email.com ON CATALOG main.

UC_COMMAND_NOT_SUPPORTED

SQLSTATE: 0AKUC

<commandName> <isOrAre> not supported in Unity Catalog.

UC_DATASOURCE_NOT_SUPPORTED

SQLSTATE: 0AKUC

Data source format <dataSourceFormatName> is not supported in Unity Catalog.

UC_DATASOURCE_OPTIONS_NOT_SUPPORTED

SQLSTATE: 0AKUC

Data source options are not supported in Unity Catalog.

UC_EXTERNAL_VOLUME_MISSING_LOCATION

SQLSTATE: none assigned

LOCATION clause must be present for external volume. Please check the syntax ‘CREATE EXTERNAL VOLUME … LOCATION …’ for creating an external volume.

UC_INVALID_DEPENDENCIES

SQLSTATE: 56098

Dependencies of <viewName> are recorded as <storedDeps> while being parsed as <parsedDeps>. This likely occurred through improper use of a non-SQL API. You can repair dependencies in Databricks Runtime by running ALTER VIEW <viewName> AS <viewText>.

UC_INVALID_NAMESPACE

SQLSTATE: 0AKUC

Nested or empty namespaces are not supported in Unity Catalog.

UC_INVALID_REFERENCE

SQLSTATE: 0AKUC

Non-Unity-Catalog object <name> can’t be referenced in Unity Catalog objects.

UC_LOCATION_FOR_MANAGED_VOLUME_NOT_SUPPORTED

SQLSTATE: none assigned

Managed volume does not accept LOCATION clause. Please check the syntax ‘CREATE VOLUME …’ for creating a managed volume.

UC_NOT_ENABLED

SQLSTATE: 56038

Unity Catalog is not enabled on this cluster.

UC_QUERY_FEDERATION_NOT_ENABLED

SQLSTATE: 56038

Unity Catalog Query Federation is not enabled on this cluster.

UC_VOLUMES_NOT_ENABLED

SQLSTATE: 56038

Support for Unity Catalog Volumes is not enabled on this instance.

UC_VOLUME_NOT_FOUND

SQLSTATE: 42704

Volume <name> does not exist. Please use ‘SHOW VOLUMES’ to list available volumes.

UDF_MAX_COUNT_EXCEEDED

SQLSTATE: 54KD0

Exceeded query-wide UDF limit of <maxNumUdfs> UDFs, found <numUdfs>. The UDFs were: <udfNames>.

UDF_PYSPARK_UNSUPPORTED_TYPE

SQLSTATE: 0A000

PySpark UDF <udf> (<eval-type>) is not supported on clusters in Shared access mode.

UDF_UNSUPPORTED_PARAMETER_DEFAULT_VALUE

SQLSTATE: 0A000

Parameter default value is not supported for user-defined <functionType> function.

UDF_USER_CODE_ERROR

SQLSTATE: 39000

Execution of function <fn> failed.

For more details see UDF_USER_CODE_ERROR

UNABLE_TO_ACQUIRE_MEMORY

SQLSTATE: 53200

Unable to acquire <requestedBytes> bytes of memory, got <receivedBytes>.

UNABLE_TO_CONVERT_TO_PROTOBUF_MESSAGE_TYPE

SQLSTATE: none assigned

Unable to convert SQL type <toType> to Protobuf type <protobufType>.

UNABLE_TO_INFER_SCHEMA

SQLSTATE: 42KD9

Unable to infer schema for <format>. It must be specified manually.

UNABLE_TO_INFER_SCHEMA_WITH_COLON_IN_FILENAME

SQLSTATE: 42KD9

Unable to infer schema due to a colon in the file name. To fix the issue, either rename all files with a colon or specify a schema manually.

UNBOUND_SQL_PARAMETER

SQLSTATE: 42P02

Found the unbound parameter: <name>. Please, fix args and provide a mapping of the parameter to a SQL literal.

UNCLOSED_BRACKETED_COMMENT

SQLSTATE: 42601

Found an unclosed bracketed comment. Please, append */ at the end of the comment.

UNEXPECTED_INPUT_TYPE

SQLSTATE: 42K09

Parameter <paramIndex> of function <functionName> requires the <requiredType> type, however <inputSql> has the type <inputType>.

UNEXPECTED_POSITIONAL_ARGUMENT

SQLSTATE: 4274K

The invocation of function <functionName> contains a positional argument after named parameter <parameterName> assignment. This is invalid.

UNKNOWN_FIELD_EXCEPTION

SQLSTATE: KD003

Encountered unknown fields during parsing: <unknownFieldBlob>, which can be fixed by an automatic retry: <isRetryable>

For more details see UNKNOWN_FIELD_EXCEPTION

UNKNOWN_POSITIONAL_ARGUMENT

SQLSTATE: 4274K

The invocation of function <functionName> contains an unknown positional argument <sqlExpr> at position <pos>. This is invalid.

UNKNOWN_PROTOBUF_MESSAGE_TYPE

SQLSTATE: none assigned

Attempting to treat <descriptorName> as a Message, but it was <containingType>.

UNKNOWN_TABLE_TYPE

SQLSTATE: XXKUC

Unsupported table table <type>.

UNPIVOT_REQUIRES_ATTRIBUTES

SQLSTATE: 42K0A

UNPIVOT requires all given <given> expressions to be columns when no <empty> expressions are given. These are not columns: [<expressions>].

UNPIVOT_REQUIRES_VALUE_COLUMNS

SQLSTATE: 42K0A

At least one value column needs to be specified for UNPIVOT, all columns specified as ids.

UNPIVOT_VALUE_DATA_TYPE_MISMATCH

SQLSTATE: 42K09

Unpivot value columns must share a least common type, some types do not: [<types>].

UNPIVOT_VALUE_SIZE_MISMATCH

SQLSTATE: 428C4

All unpivot value columns must have the same size as there are value column names (<names>).

UNRECOGNIZED_SQL_TYPE

SQLSTATE: 42704

Unrecognized SQL type - name: <typeName>, id: <jdbcType>.

UNRESOLVED_ALL_IN_GROUP_BY

SQLSTATE: 42803

Cannot infer grouping columns for GROUP BY ALL based on the select clause. Please explicitly specify the grouping columns.

UNRESOLVED_COLUMN

SQLSTATE: 42703

A column or function parameter with name <objectName> cannot be resolved.

For more details see UNRESOLVED_COLUMN

UNRESOLVED_FIELD

SQLSTATE: 42703

A field with name <fieldName> cannot be resolved with the struct-type column <columnPath>.

For more details see UNRESOLVED_FIELD

UNRESOLVED_MAP_KEY

SQLSTATE: 42703

Cannot resolve column <objectName> as a map key. If the key is a string literal, add the single quotes ‘’ around it.

For more details see UNRESOLVED_MAP_KEY

UNRESOLVED_ROUTINE

SQLSTATE: 42883

Cannot resolve function <routineName> on search path <searchPath>.

For more details see UNRESOLVED_ROUTINE

UNRESOLVED_USING_COLUMN_FOR_JOIN

SQLSTATE: 42703

USING column <colName> cannot be resolved on the <side> side of the join. The <side>-side columns: [<suggestion>].

UNSUPPORTED_ARROWTYPE

SQLSTATE: 0A000

Unsupported arrow type <typeName>.

UNSUPPORTED_CONSTRAINT_CLAUSES

SQLSTATE: 0A000

Constraint clauses <clauses> are unsupported.

UNSUPPORTED_CONSTRAINT_TYPE

SQLSTATE: 42000

Unsupported constraint type. Only <supportedConstraintTypes> are supported

UNSUPPORTED_DATASOURCE_FOR_DIRECT_QUERY

SQLSTATE: none assigned

Unsupported data source type for direct query on files: <dataSourceType>

UNSUPPORTED_DATATYPE

SQLSTATE: 0A000

Unsupported data type <typeName>.

UNSUPPORTED_DESERIALIZER

SQLSTATE: 0A000

The deserializer is not supported:

For more details see UNSUPPORTED_DESERIALIZER

UNSUPPORTED_EXPRESSION_GENERATED_COLUMN

SQLSTATE: none assigned

Cannot create generated column <fieldName> with generation expression <expressionStr> because <reason>.

UNSUPPORTED_EXPR_FOR_OPERATOR

SQLSTATE: none assigned

A query operator contains one or more unsupported expressions. Consider to rewrite it to avoid window functions, aggregate functions, and generator functions in the WHERE clause.

Invalid expressions: [<invalidExprSqls>]

UNSUPPORTED_EXPR_FOR_WINDOW

SQLSTATE: 42P20

Expression <sqlExpr> not supported within a window function.

UNSUPPORTED_FEATURE

SQLSTATE: 0A000

The feature is not supported:

For more details see UNSUPPORTED_FEATURE

UNSUPPORTED_FN_TYPE

SQLSTATE: 0A000

Unsupported user defined function type: <language>

UNSUPPORTED_GENERATOR

SQLSTATE: 0A000

The generator is not supported:

For more details see UNSUPPORTED_GENERATOR

UNSUPPORTED_GROUPING_EXPRESSION

SQLSTATE: none assigned

grouping()/grouping_id() can only be used with GroupingSets/Cube/Rollup.

UNSUPPORTED_INITIAL_POSITION_AND_TRIGGER_PAIR_FOR_KINESIS_SOURCE

SQLSTATE: 42616

<trigger> with initial position <initialPosition> is not supported with the Kinesis source

UNSUPPORTED_SAVE_MODE

SQLSTATE: none assigned

The save mode <saveMode> is not supported for:

For more details see UNSUPPORTED_SAVE_MODE

UNSUPPORTED_STREAMING_OPTIONS_PERMISSION_ENFORCED

SQLSTATE: none assigned

Streaming options <options> are not supported for data source <source> on a shared cluster.

UNSUPPORTED_STREAMING_SINK_PERMISSION_ENFORCED

SQLSTATE: none assigned

Data source <sink> is not supported as a streaming sink on a shared cluster.

UNSUPPORTED_STREAMING_SOURCE_PERMISSION_ENFORCED

SQLSTATE: none assigned

Data source <source> is not supported as a streaming source on a shared cluster.

UNSUPPORTED_STREAMING_TABLE_VALUED_FUNCTION

SQLSTATE: 42000

The function <funcName> does not support streaming. Please remove the STREAM keyword

UNSUPPORTED_STREAM_READ_LIMIT_FOR_KINESIS_SOURCE

SQLSTATE: 0A000

<streamReadLimit> is not supported with the Kinesis source

UNSUPPORTED_TRIGGER_FOR_KINESIS_SOURCE

SQLSTATE: 0A000

<trigger> is not supported with the Kinesis source

UNSUPPORTED_TYPED_LITERAL

SQLSTATE: 0A000

Literals of the type <unsupportedType> are not supported. Supported types are <supportedTypes>.

UNTYPED_SCALA_UDF

SQLSTATE: none assigned

You’re using untyped Scala UDF, which does not have the input type information. Spark may blindly pass null to the Scala closure with primitive-type argument, and the closure will see the default value of the Java type for the null argument, e.g. udf((x: Int) => x, IntegerType), the result is 0 for null input. To get rid of this error, you could:

  1. use typed Scala UDF APIs(without return type parameter), e.g. udf((x: Int) => x).

  2. use Java UDF APIs, e.g. udf(new UDF1[String, Integer] { override def call(s: String): Integer = s.length() }, IntegerType), if input types are all non primitive.

  3. set “spark.sql.legacy.allowUntypedScalaUDF” to “true” and use this API with caution.

UPGRADE_NOT_SUPPORTED

SQLSTATE: 0AKUC

Table is not eligible for upgrade from Hive Metastore to Unity Catalog. Reason:

For more details see UPGRADE_NOT_SUPPORTED

USER_DEFINED_FUNCTIONS

SQLSTATE: 42601

User defined function is invalid:

For more details see USER_DEFINED_FUNCTIONS

VIEW_ALREADY_EXISTS

SQLSTATE: 42P07

Cannot create view <relationName> because it already exists.

Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.

VIEW_NOT_FOUND

SQLSTATE: 42P01

The view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VIEW IF EXISTS.

VOLUME_ALREADY_EXISTS

SQLSTATE: 42000

Cannot create volume <relationName> because it already exists.

Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.

WITH_CREDENTIAL

SQLSTATE: 42601

WITH CREDENTIAL syntax is not supported for <type>.

WRITE_STREAM_NOT_ALLOWED

SQLSTATE: none assigned

writeStream can be called only on streaming Dataset/DataFrame.

WRONG_COLUMN_DEFAULTS_FOR_DELTA_ALTER_TABLE_ADD_COLUMN_NOT_SUPPORTED

SQLSTATE: 0AKDC

Failed to execute the command because DEFAULT values are not supported when adding new columns to previously existing Delta tables; please add the column without a default value first, then run a second ALTER TABLE ALTER COLUMN SET DEFAULT command to apply for future inserted rows instead.

WRONG_COLUMN_DEFAULTS_FOR_DELTA_FEATURE_NOT_ENABLED

SQLSTATE: 0AKDE

Failed to execute <commandType> command because it assigned a column DEFAULT value, but the corresponding table feature was not enabled. Please retry the command again after executing ALTER TABLE tableName SET TBLPROPERTIES(‘delta.feature.allowColumnDefaults’ = ‘supported’).

WRONG_COMMAND_FOR_OBJECT_TYPE

SQLSTATE: none assigned

The operation <operation> requires a <requiredType>. But <objectName> is a <foundType>. Use <alternative> instead.

WRONG_NUM_ARGS

SQLSTATE: 42605

The <functionName> requires <expectedNum> parameters but the actual number is <actualNum>.

For more details see WRONG_NUM_ARGS

ZORDERBY_COLUMN_DOES_NOT_EXIST

SQLSTATE: 42703

ZOrderBy column <columnName> doesn’t exist.

Delta Lake

DELTA_ACTIVE_SPARK_SESSION_NOT_FOUND

SQLSTATE: 08003

Could not find active SparkSession

DELTA_ACTIVE_TRANSACTION_ALREADY_SET

SQLSTATE: 0B000

Cannot set a new txn as active when one is already active

DELTA_ADDING_COLUMN_WITH_INTERNAL_NAME_FAILED

SQLSTATE: 42000

Failed to add column <colName> because the name is reserved.

DELTA_ADDING_DELETION_VECTORS_DISALLOWED

SQLSTATE: 0A000

The current operation attempted to add a deletion vector to a table that does not permit the creation of new deletion vectors. Please file a bug report.

DELTA_ADDING_DELETION_VECTORS_WITH_TIGHT_BOUNDS_DISALLOWED

SQLSTATE: 42000

All operations that add deletion vectors should set the tightBounds column in statistics to false. Please file a bug report.

DELTA_ADD_COLUMN_AT_INDEX_LESS_THAN_ZERO

SQLSTATE: 42KD3

Index <columnIndex> to add column <columnName> is lower than 0

DELTA_ADD_COLUMN_PARENT_NOT_STRUCT

SQLSTATE: 42KD3

Cannot add <columnName> because its parent is not a StructType. Found <other>

DELTA_ADD_COLUMN_STRUCT_NOT_FOUND

SQLSTATE: 42KD3

Struct not found at position <position>

DELTA_ADD_CONSTRAINTS

SQLSTATE: 0A000

Please use ALTER TABLE ADD CONSTRAINT to add CHECK constraints.

DELTA_AGGREGATE_IN_GENERATED_COLUMN

SQLSTATE: 42621

Found <sqlExpr>. A generated column cannot use an aggregate expression

DELTA_AGGREGATION_NOT_SUPPORTED

SQLSTATE: 42903

Aggregate functions are not supported in the <operation> <predicate>.

DELTA_ALTER_TABLE_CHANGE_COL_NOT_SUPPORTED

SQLSTATE: 42837

ALTER TABLE CHANGE COLUMN is not supported for changing column <currentType> to <newType>

DELTA_ALTER_TABLE_RENAME_NOT_ALLOWED

SQLSTATE: 42000

Operation not allowed: ALTER TABLE RENAME TO is not allowed for managed Delta tables on S3, as eventual consistency on S3 may corrupt the Delta transaction log. If you insist on doing so and are sure that there has never been a Delta table with the new name <newName> before, you can enable this by setting <key> to be true.

DELTA_AMBIGUOUS_PARTITION_COLUMN

SQLSTATE: 42702

Ambiguous partition column <column> can be <colMatches>.

DELTA_AMBIGUOUS_PATHS_IN_CREATE_TABLE

SQLSTATE: 42613

CREATE TABLE contains two different locations: <identifier> and <location>.

You can remove the LOCATION clause from the CREATE TABLE statement, or set

<config> to true to skip this check.

DELTA_ARCHIVED_FILES_IN_LIMIT

SQLSTATE: 42KDC

Table <table> does not contain enough records in non-archived files to satisfy specified LIMIT of <limit> records.

DELTA_ARCHIVED_FILES_IN_SCAN

SQLSTATE: 42KDC

Found <numArchivedFiles> potentially archived file(s) in table <table> that need to be scanned as part of this query. Archived files cannot be accessed. The current time until archival is configured as <archivalTime>. Please adjust your query filters to exclude any archived files.

DELTA_BLOCK_COLUMN_MAPPING_AND_CDC_OPERATION

SQLSTATE: 42KD4

Operation “<opName>” is not allowed when the table has enabled change data feed (CDF) and has undergone schema changes using DROP COLUMN or RENAME COLUMN.

DELTA_BLOOM_FILTER_DROP_ON_NON_EXISTING_COLUMNS

SQLSTATE: 42703

Cannot drop bloom filter indices for the following non-existent column(s): <unknownColumns>

DELTA_CANNOT_CHANGE_DATA_TYPE

SQLSTATE: 429BQ

Cannot change data type: <dataType>

DELTA_CANNOT_CHANGE_LOCATION

SQLSTATE: 42601

Cannot change the ‘location’ of the Delta table using SET TBLPROPERTIES. Please use ALTER TABLE SET LOCATION instead.

DELTA_CANNOT_CHANGE_PROVIDER

SQLSTATE: 42939

‘provider’ is a reserved table property, and cannot be altered.

DELTA_CANNOT_CONVERT_TO_FILEFORMAT

SQLSTATE: XXKDS

Can not convert`<className>` to FileFormat.

DELTA_CANNOT_CREATE_BLOOM_FILTER_NON_EXISTING_COL

SQLSTATE: 42703

Cannot create bloom filter indices for the following non-existent column(s): <unknownCols>

DELTA_CANNOT_CREATE_LOG_PATH

SQLSTATE: 42KD5

Cannot create <path>

DELTA_CANNOT_DESCRIBE_VIEW_HISTORY

SQLSTATE: 42809

Cannot describe the history of a view.

DELTA_CANNOT_DROP_BLOOM_FILTER_ON_NON_INDEXED_COLUMN

SQLSTATE: 42703

Cannot drop bloom filter index on a non indexed column: <columnName>

DELTA_CANNOT_EVALUATE_EXPRESSION

SQLSTATE: 0AKDC

Cannot evaluate expression: <expression>

DELTA_CANNOT_FIND_BUCKET_SPEC

SQLSTATE: 22000

Expecting a bucketing Delta table but cannot find the bucket spec in the table

DELTA_CANNOT_FIND_VERSION

SQLSTATE: XXKDS

Cannot find ‘sourceVersion’ in <json>

DELTA_CANNOT_GENERATE_CODE_FOR_EXPRESSION

SQLSTATE: 0AKDC

Cannot generate code for expression: <expression>

DELTA_CANNOT_GENERATE_UPDATE_EXPRESSIONS

SQLSTATE: XXKDS

Calling without generated columns should always return a update expression for each column

DELTA_CANNOT_MODIFY_APPEND_ONLY

SQLSTATE: 42809

This table is configured to only allow appends. If you would like to permit updates or deletes, use ‘ALTER TABLE <table_name> SET TBLPROPERTIES (<config>=false)’.

DELTA_CANNOT_MODIFY_TABLE_PROPERTY

SQLSTATE: 42939

The Delta table configuration <prop> cannot be specified by the user

DELTA_CANNOT_RECONSTRUCT_PATH_FROM_URI

SQLSTATE: 22KD1

A uri (<uri>) which can’t be turned into a relative path was found in the transaction log.

DELTA_CANNOT_RELATIVIZE_PATH

SQLSTATE: 42000

A path (<path>) which can’t be relativized with the current input found in the

transaction log. Please re-run this as:

%%scala com.databricks.delta.Delta.fixAbsolutePathsInLog(“<userPath>”, true)

and then also run:

%%scala com.databricks.delta.Delta.fixAbsolutePathsInLog(“<path>”)

DELTA_CANNOT_RENAME_PATH

SQLSTATE: 22KD1

Cannot rename <currentPath> to <newPath>

DELTA_CANNOT_REPLACE_MISSING_TABLE

SQLSTATE: 42P01

Table <tableName> cannot be replaced as it does not exist. Use CREATE OR REPLACE TABLE to create the table.

DELTA_CANNOT_RESOLVE_COLUMN

SQLSTATE: 42703

Can’t resolve column <columnName> in <schema>

DELTA_CANNOT_RESOLVE_SOURCE_COLUMN

SQLSTATE: XXKDS

Couldn’t resolve qualified source column <columnName> within the source query. Please contact Databricks support.

DELTA_CANNOT_RESTORE_TABLE_VERSION

SQLSTATE: 22003

Cannot restore table to version <version>. Available versions: [<startVersion>, <endVersion>].

DELTA_CANNOT_RESTORE_TIMESTAMP_GREATER

SQLSTATE: 22003

Cannot restore table to timestamp (<requestedTimestamp>) as it is after the latest version available. Please use a timestamp before (<latestTimestamp>)

DELTA_CANNOT_SET_LOCATION_MULTIPLE_TIMES

SQLSTATE: XXKDS

Can’t set location multiple times. Found <location>

DELTA_CANNOT_SET_LOCATION_ON_PATH_IDENTIFIER

SQLSTATE: 42613

Cannot change the location of a path based table.

DELTA_CANNOT_UPDATE_ARRAY_FIELD

SQLSTATE: 429BQ

Cannot update %1$s field %2$s type: update the element by updating %2$s.element

DELTA_CANNOT_UPDATE_MAP_FIELD

SQLSTATE: 429BQ

Cannot update %1$s field %2$s type: update a map by updating %2$s.key or %2$s.value

DELTA_CANNOT_UPDATE_OTHER_FIELD

SQLSTATE: 429BQ

Cannot update <tableName> field of type <typeName>

DELTA_CANNOT_UPDATE_STRUCT_FIELD

SQLSTATE: 429BQ

Cannot update <tableName> field <fieldName> type: update struct by adding, deleting, or updating its fields

DELTA_CANNOT_USE_ALL_COLUMNS_FOR_PARTITION

SQLSTATE: 428FT

Cannot use all columns for partition columns

DELTA_CANNOT_WRITE_INTO_VIEW

SQLSTATE: 0A000

<table> is a view. Writes to a view are not supported.

DELTA_CDC_NOT_ALLOWED_IN_THIS_VERSION

SQLSTATE: 0AKDC

Configuration delta.enableChangeDataFeed cannot be set. Change data feed from Delta is not yet available.

DELTA_CHANGE_DATA_FEED_INCOMPATIBLE_DATA_SCHEMA

SQLSTATE: 0AKDC

Retrieving table changes between version <start> and <end> failed because of an incompatible data schema.

Your read schema is <readSchema> at version <readVersion>, but we found an incompatible data schema at version <incompatibleVersion>.

If possible, please retrieve the table changes using the end version’s schema by setting <config> to endVersion, or contact support.

DELTA_CHANGE_DATA_FEED_INCOMPATIBLE_SCHEMA_CHANGE

SQLSTATE: 0AKDC

Retrieving table changes between version <start> and <end> failed because of an incompatible schema change.

Your read schema is <readSchema> at version <readVersion>, but we found an incompatible schema change at version <incompatibleVersion>.

If possible, please query table changes separately from version <start> to <incompatibleVersion> - 1, and from version <incompatibleVersion> to <end>.

DELTA_CHANGE_DATA_FILE_NOT_FOUND

SQLSTATE: 42K03

File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This request appears to be targeting Change Data Feed, if that is the case, this error can occur when the change data file is out of the retention period and has been deleted by the VACUUM statement. For more information, see <faqPath>

DELTA_CHANGE_TABLE_FEED_DISABLED

SQLSTATE: 42807

Cannot write to table with delta.enableChangeDataFeed set. Change data feed from Delta is not available.

DELTA_CHECKPOINT_NON_EXIST_TABLE

SQLSTATE: 42K03

Cannot checkpoint a non-existing table <path>. Did you manually delete files in the deltalog directory?

DELTA_CHECKPOINT_SNAPSHOT_MISMATCH

SQLSTATE: XXKDS

State of the checkpoint doesn’t match that of the snapshot.

DELTA_CLONE_AMBIGUOUS_TARGET

SQLSTATE: 42613

Two paths were provided as the CLONE target so it is ambiguous which to use. An external

location for CLONE was provided at <externalLocation> at the same time as the path

<targetIdentifier>.

DELTA_CLONE_INCOMPLETE_FILE_COPY

SQLSTATE: 42000

File (<fileName>) not copied completely. Expected file size: <expectedSize>, found: <actualSize>. To continue with the operation by ignoring the file size check set <config> to false.

DELTA_CLONE_UNSUPPORTED_SOURCE

SQLSTATE: 0AKDC

Unsupported <mode> clone source ‘<name>’, whose format is <format>.

The supported formats are ‘delta’, ‘iceberg’ and ‘parquet’.

DELTA_COLUMN_MAPPING_MAX_COLUMN_ID_NOT_SET

SQLSTATE: 42703

The max column id property (<prop>) is not set on a column mapping enabled table.

DELTA_COLUMN_MAPPING_MAX_COLUMN_ID_NOT_SET_CORRECTLY

SQLSTATE: 42703

The max column id property (<prop>) on a column mapping enabled table is <tableMax>, which cannot be smaller than the max column id for all fields (<fieldMax>).

DELTA_COLUMN_NOT_FOUND

SQLSTATE: 42703

Unable to find the column <columnName> given [<columnList>]

DELTA_COLUMN_NOT_FOUND_IN_MERGE

SQLSTATE: 42703

Unable to find the column ‘<targetCol>’ of the target table from the INSERT columns: <colNames>. INSERT clause must specify value for all the columns of the target table.

DELTA_COLUMN_NOT_FOUND_IN_SCHEMA

SQLSTATE: 42703

Couldn’t find column <columnName> in:

<tableSchema>

DELTA_COLUMN_PATH_NOT_NESTED

SQLSTATE: 42704

Expected <columnPath> to be a nested data type, but found <other>. Was looking for the

index of <column> in a nested field

DELTA_COLUMN_STRUCT_TYPE_MISMATCH

SQLSTATE: 2200G

Struct column <source> cannot be inserted into a <targetType> field <targetField> in <targetTable>.

DELTA_COMPACTION_VALIDATION_FAILED

SQLSTATE: 22000

The validation of the compaction of path <compactedPath> to <newPath> failed: Please file a bug report.

DELTA_COMPLEX_TYPE_COLUMN_CONTAINS_NULL_TYPE

SQLSTATE: 22005

Found nested NullType in column <columName> which is of <dataType>. Delta doesn’t support writing NullType in complex types.

DELTA_CONFLICT_SET_COLUMN

SQLSTATE: 42701

There is a conflict from these SET columns: <columnList>.

DELTA_CONSTRAINT_ALREADY_EXISTS

SQLSTATE: 42710

Constraint ‘<constraintName>’ already exists. Please delete the old constraint first.

Old constraint:

<oldConstraint>

DELTA_CONSTRAINT_DOES_NOT_EXIST

SQLSTATE: 42704

Cannot drop nonexistent constraint <constraintName> from table <tableName>. To avoid throwing an error, provide the parameter IF EXISTS or set the SQL session configuration <config> to <confValue>.

DELTA_CONVERSION_NO_PARTITION_FOUND

SQLSTATE: 42KD6

Found no partition information in the catalog for table <tableName>. Have you run “MSCK REPAIR TABLE” on your table to discover partitions?

DELTA_CONVERSION_UNSUPPORTED_COLUMN_MAPPING

SQLSTATE: 0AKDC

The configuration ‘<config>’ cannot be set to <mode> when using CONVERT TO DELTA.

DELTA_CONVERT_NON_PARQUET_TABLE

SQLSTATE: 0AKDC

CONVERT TO DELTA only supports parquet tables, but you are trying to convert a <sourceName> source: <tableId>

DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_SCHEMA

SQLSTATE: 42601

You are trying to create an external table <tableName>

from <path> using Delta, but the schema is not specified when the

input path is empty.

To learn more about Delta, see <docLink>

DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_TXN_LOG

SQLSTATE: 42K03

You are trying to create an external table <tableName>

from %2$s using Delta, but there is no transaction log present at

%2$s/_delta_log. Check the upstream job to make sure that it is writing using

format(“delta”) and that the path is the root of the table.

To learn more about Delta, see <docLink>

DELTA_CREATE_TABLE_SCHEME_MISMATCH

SQLSTATE: 42KD7

The specified schema does not match the existing schema at <path>.

== Specified ==

<specifiedSchema>

== Existing ==

<existingSchema>

== Differences ==

<schemaDifferences>

If your intention is to keep the existing schema, you can omit the

schema from the create table command. Otherwise please ensure that

the schema matches.

DELTA_CREATE_TABLE_WITH_DIFFERENT_PARTITIONING

SQLSTATE: 42KD7

The specified partitioning does not match the existing partitioning at <path>.

== Specified ==

<specifiedColumns>

== Existing ==

<existingColumns>

DELTA_CREATE_TABLE_WITH_DIFFERENT_PROPERTY

SQLSTATE: 42KD7

The specified properties do not match the existing properties at <path>.

== Specified ==

<specificiedProperties>

== Existing ==

<existingProperties>

DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION

SQLSTATE: 42601

Cannot create table (‘<tableId>’). The associated location (‘<tableLocation>’) is not empty and also not a Delta table.

DELTA_DATA_CHANGE_FALSE

SQLSTATE: 0AKDE

Cannot change table metadata because the ‘dataChange’ option is set to false. Attempted operation: ‘<op>’.

DELTA_DELETION_VECTOR_CHECKSUM_MISMATCH

SQLSTATE: XXKDS

Could not verify deletion vector integrity, CRC checksum verification failed.

DELTA_DELETION_VECTOR_INVALID_ROW_INDEX

SQLSTATE: XXKDS

Deletion vector integrity check failed. Encountered an invalid row index.

DELTA_DELETION_VECTOR_MISSING_NUM_RECORDS

SQLSTATE: 2D521

It is invalid to commit files with deletion vectors that are missing the numRecords statistic.

DELTA_DELETION_VECTOR_SIZE_MISMATCH

SQLSTATE: XXKDS

Deletion vector integrity check failed. Encountered a size mismatch.

DELTA_DROP_COLUMN_AT_INDEX_LESS_THAN_ZERO

SQLSTATE: 42KD8

Index <columnIndex> to drop column is lower than 0

DELTA_DUPLICATE_ACTIONS_FOUND

SQLSTATE: 2D521

File operation ‘<actionType>’ for path <path> was specified several times.

It conflicts with <conflictingPath>.

It is not valid for multiple file operations with the same path to exist in a single commit.

DELTA_DUPLICATE_COLUMNS_FOUND

SQLSTATE: 42711

Found duplicate column(s) <coltype>: <duplicateCols>

DELTA_DUPLICATE_COLUMNS_ON_INSERT

SQLSTATE: 42701

Duplicate column names in INSERT clause

DELTA_DUPLICATE_COLUMNS_ON_UPDATE_TABLE

SQLSTATE: 42701

<message>

Please remove duplicate columns before you update your table.

DELTA_DV_HISTOGRAM_DESERIALIZATON

SQLSTATE: 22000

Could not deserialize the deleted record counts histogram during table integrity verification.

DELTA_EMPTY_DATA

SQLSTATE: 428GU

Data used in creating the Delta table doesn’t have any columns.

DELTA_EMPTY_DIRECTORY

SQLSTATE: 42K03

No file found in the directory: <directory>.

DELTA_EXCEED_CHAR_VARCHAR_LIMIT

SQLSTATE: 22001

Exceeds char/varchar type length limitation. Failed check: <expr>.

DELTA_EXPRESSIONS_NOT_FOUND_IN_GENERATED_COLUMN

SQLSTATE: XXKDS

Cannot find the expressions in the generated column <columnName>

DELTA_EXTRACT_REFERENCES_FIELD_NOT_FOUND

SQLSTATE: XXKDS

Field <fieldName> could not be found when extracting references.

DELTA_FAILED_CAST_PARTITION_VALUE

SQLSTATE: 22018

Failed to cast partition value <value> to <dataType>

DELTA_FAILED_FIND_ATTRIBUTE_IN_OUTPUT_COLUMNS

SQLSTATE: 42703

Could not find <newAttributeName> among the existing target output <targetOutputColumns>

DELTA_FAILED_FIND_PARTITION_COLUMN_IN_OUTPUT_PLAN

SQLSTATE: XXKDS

Could not find <partitionColumn> in output plan.

DELTA_FAILED_INFER_SCHEMA

SQLSTATE: 42KD9

Failed to infer schema from the given list of files.

DELTA_FAILED_MERGE_SCHEMA_FILE

SQLSTATE: 42KDA

Failed to merge schema of file <file>:

<schema>

DELTA_FAILED_RECOGNIZE_PREDICATE

SQLSTATE: 42601

Cannot recognize the predicate ‘<predicate>

DELTA_FAILED_SCAN_WITH_HISTORICAL_VERSION

SQLSTATE: KD002

Expect a full scan of the latest version of the Delta source, but found a historical scan of version <historicalVersion>

DELTA_FAILED_TO_MERGE_FIELDS

SQLSTATE: 22005

Failed to merge fields ‘<field>’ and ‘<fieldRoot>’. <fieldChild>

DELTA_FAIL_RELATIVIZE_PATH

SQLSTATE: XXKDS

Failed to relativize the path (<path>). This can happen when absolute paths make

it into the transaction log, which start with the scheme

s3://, wasbs:// or adls://. This is a bug that has existed before DBR 5.0.

To fix this issue, please upgrade your writer jobs to DBR 5.0 and please run:

%%scala com.databricks.delta.Delta.fixAbsolutePathsInLog(“<path>”).

If this table was created with a shallow clone across file systems

(different buckets/containers) and this table is NOT USED IN PRODUCTION, you can

set the SQL configuration <config>

to true. Using this SQL configuration could lead to accidental data loss,

therefore we do not recommend the use of this flag unless

this is a shallow clone for testing purposes.

DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

SQLSTATE: 0AKDE

Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: <features>.

DELTA_FEATURES_REQUIRE_MANUAL_ENABLEMENT

SQLSTATE: 0AKDE

Your table schema requires manually enablement of the following table feature(s): <unsupportedFeatures>.

To do this, run the following command for each of features listed above:

ALTER TABLE table_name SET TBLPROPERTIES (‘delta.feature.feature_name’ = ‘supported’)

Replace “table_name” and “feature_name” with real values.

Note that the procedure is irreversible: once supported, a feature can never be unsupported again.

Current supported feature(s): <supportedFeatures>.

DELTA_FEATURE_REQUIRES_HIGHER_READER_VERSION

SQLSTATE: 0AKDE

Unable to enable table feature <feature> because it requires a higher reader protocol version (current <current>). Consider upgrading the table’s reader protocol version to <required>, or to a version which supports reader table features. Refer to <docLink> for more information on table protocol versions.

DELTA_FEATURE_REQUIRES_HIGHER_WRITER_VERSION

SQLSTATE: 0AKDE

Unable to enable table feature <feature> because it requires a higher writer protocol version (current <current>). Consider upgrading the table’s writer protocol version to <required>, or to a version which supports writer table features. Refer to <docLink> for more information on table protocol versions.

DELTA_FILE_ALREADY_EXISTS

SQLSTATE: 42K04

Existing file path <path>

DELTA_FILE_LIST_AND_PATTERN_STRING_CONFLICT

SQLSTATE: 42613

Cannot specify both file list and pattern string.

DELTA_FILE_NOT_FOUND

SQLSTATE: 42K03

File path <path>

DELTA_FILE_NOT_FOUND_DETAILED

SQLSTATE: 42K03

File <filePath> referenced in the transaction log cannot be found. This occurs when data has been manually deleted from the file system rather than using the table DELETE statement. For more information, see <faqPath>

DELTA_FILE_OR_DIR_NOT_FOUND

SQLSTATE: 42K03

No such file or directory: <path>

DELTA_FILE_TO_OVERWRITE_NOT_FOUND

SQLSTATE: 42K03

File (<path>) to be rewritten not found among candidate files:

<pathList>

DELTA_FOUND_MAP_TYPE_COLUMN

SQLSTATE: KD003

A MapType was found. In order to access the key or value of a MapType, specify one

of:

<key> or

<value>

followed by the name of the column (only if that column is a struct type).

e.g. mymap.key.mykey

If the column is a basic type, mymap.key or mymap.value is sufficient.

DELTA_GENERATED_COLUMNS_DATA_TYPE_MISMATCH

SQLSTATE: 42K09

Column <columnName> is a generated column or a column used by a generated column. The data type is <columnType>. It doesn’t accept data type <dataType>

DELTA_GENERATED_COLUMNS_EXPR_TYPE_MISMATCH

SQLSTATE: 42K09

The expression type of the generated column <columnName> is <expressionType>, but the column type is <columnType>

DELTA_GENERATED_COLUMN_UPDATE_TYPE_MISMATCH

SQLSTATE: 42K09

Column <currentName> is a generated column or a column used by a generated column. The data type is <currentDataType> and cannot be converted to data type <updateDataType>

DELTA_ILLEGAL_FILE_FOUND

SQLSTATE: XXKDS

Illegal files found in a dataChange = false transaction. Files: <file>

DELTA_ILLEGAL_OPTION

SQLSTATE: 42616

Invalid value ‘<input>’ for option ‘<name>’, <explain>

DELTA_ILLEGAL_USAGE

SQLSTATE: 42601

The usage of <option> is not allowed when <operation> a Delta table.

DELTA_INCONSISTENT_BUCKET_SPEC

SQLSTATE: 42000

BucketSpec on Delta bucketed table does not match BucketSpec from metadata.Expected: <expected>. Actual: <actual>.

DELTA_INCONSISTENT_LOGSTORE_CONFS

SQLSTATE: F0000

(<setKeys>) cannot be set to different values. Please only set one of them, or set them to the same value.

DELTA_INCORRECT_ARRAY_ACCESS

SQLSTATE: KD003

Incorrectly accessing an ArrayType. Use arrayname.element.elementname position to

add to an array.

DELTA_INCORRECT_ARRAY_ACCESS_BY_NAME

SQLSTATE: KD003

An ArrayType was found. In order to access elements of an ArrayType, specify

<rightName>

Instead of <wrongName>

DELTA_INCORRECT_GET_CONF

SQLSTATE: 42000

Use getConf() instead of `conf.getConf()

DELTA_INCORRECT_LOG_STORE_IMPLEMENTATION

SQLSTATE: 0AKDC

The error typically occurs when the default LogStore implementation, that

is, HDFSLogStore, is used to write into a Delta table on a non-HDFS storage system.

In order to get the transactional ACID guarantees on table updates, you have to use the

correct implementation of LogStore that is appropriate for your storage system.

See <docLink> for details.

DELTA_INDEX_LARGER_OR_EQUAL_THAN_STRUCT

SQLSTATE: 42KD8

Index <position> to drop column equals to or is larger than struct length: <length>

DELTA_INDEX_LARGER_THAN_STRUCT

SQLSTATE: 42KD8

Index <index> to add column <columnName> is larger than struct length: <length>

DELTA_INSERT_COLUMN_ARITY_MISMATCH

SQLSTATE: 42802

Cannot write to ‘<tableName>’, <columnName>; target table has <numColumns> column(s) but the inserted data has <insertColumns> column(s)

DELTA_INSERT_COLUMN_MISMATCH

SQLSTATE: 42802

Column <columnName> is not specified in INSERT

DELTA_INVALID_BUCKET_COUNT

SQLSTATE: 22023

Invalid bucket count: <invalidBucketCount>. Bucket count should be a positive number that is power of 2 and at least 8. You can use <validBucketCount> instead.

DELTA_INVALID_BUCKET_INDEX

SQLSTATE: 22023

Cannot find the bucket column in the partition columns

DELTA_INVALID_CALENDAR_INTERVAL_EMPTY

SQLSTATE: 2200P

Interval cannot be null or blank.

DELTA_INVALID_CDC_RANGE

SQLSTATE: 22003

CDC range from start <start> to end <end> was invalid. End cannot be before start.

DELTA_INVALID_CHARACTERS_IN_COLUMN_NAME

SQLSTATE: 42K05

Attribute name “<columnName>” contains invalid character(s) among ” ,;{}()\n\t=”. Please use alias to rename it.

DELTA_INVALID_CHARACTERS_IN_COLUMN_NAMES

SQLSTATE: 42K05

Found invalid character(s) among ‘ ,;{}()nt=’ in the column names of your schema. <advice>

DELTA_INVALID_CLONE_PATH

SQLSTATE: 22KD1

The target location for CLONE needs to be an absolute path or table name. Use an

absolute path instead of <path>.

DELTA_INVALID_COMMITTED_VERSION

SQLSTATE: XXKDS

The committed version is <committedVersion> but the current version is <currentVersion>. Please contact Databricks support.

DELTA_INVALID_FORMAT

SQLSTATE: 22000

Incompatible format detected.

A transaction log for Delta was found at ``<deltaRootPath>/_delta_log,

but you are trying to <operation> <path> using format(“<format>”). You must use

‘format(“delta”)’ when reading and writing to a delta table.

To learn more about Delta, see <docLink>

DELTA_INVALID_FORMAT_FROM_SOURCE_VERSION

SQLSTATE: XXKDS

Unsupported format. Expected version should be smaller than or equal to <expectedVersion> but was <realVersion>. Please upgrade to newer version of Delta.

DELTA_INVALID_GENERATED_COLUMN_REFERENCES

SQLSTATE: 42621

A generated column cannot use a non-existent column or another generated column

DELTA_INVALID_IDEMPOTENT_WRITES_OPTIONS

SQLSTATE: 42616

Invalid options for idempotent Dataframe writes: <reason>

DELTA_INVALID_INTERVAL

SQLSTATE: 22006

<interval> is not a valid INTERVAL.

DELTA_INVALID_ISOLATION_LEVEL

SQLSTATE: 25000

invalid isolation level ‘<isolationLevel>

DELTA_INVALID_LOGSTORE_CONF

SQLSTATE: F0000

(<classConfig>) and (<schemeConfig>) cannot be set at the same time. Please set only one group of them.

DELTA_INVALID_MANAGED_TABLE_SYNTAX_NO_SCHEMA

SQLSTATE: 42000

You are trying to create a managed table <tableName>

using Delta, but the schema is not specified.

To learn more about Delta, see <docLink>

DELTA_INVALID_PARTITIONING_SCHEMA

SQLSTATE: XXKDS

The AddFile contains partitioning schema different from the table’s partitioning schema

expected: <neededPartitioning>

actual: <specifiedPartitioning>

To disable this check set <config> to “false”

DELTA_INVALID_PARTITION_COLUMN

SQLSTATE: 42996

<columnName> is not a valid partition column in table <tableName>.

DELTA_INVALID_PARTITION_COLUMN_NAME

SQLSTATE: 42996

Found partition columns having invalid character(s) among ” ,;{}()nt=”. Please change the name to your partition columns. This check can be turned off by setting spark.conf.set(“spark.databricks.delta.partitionColumnValidity.enabled”, false) however this is not recommended as other features of Delta may not work properly.

DELTA_INVALID_PARTITION_COLUMN_TYPE

SQLSTATE: 42996

Using column <name> of type <dataType> as a partition column is not supported.

DELTA_INVALID_PARTITION_PATH

SQLSTATE: 22KD1

A partition path fragment should be the form like part1=foo/part2=bar. The partition path: <path>

DELTA_INVALID_PROTOCOL_DOWNGRADE

SQLSTATE: KD004

Protocol version cannot be downgraded from <oldProtocol> to <newProtocol>

DELTA_INVALID_PROTOCOL_VERSION

SQLSTATE: KD004

Delta protocol version is too new for this version of Databricks: table requires <required>, client supports up to <supported>. Please upgrade to a newer release.

DELTA_INVALID_SOURCE_VERSION

SQLSTATE: XXKDS

sourceVersion(<version>) is invalid

DELTA_INVALID_TABLE_VALUE_FUNCTION

SQLSTATE: 22000

Function <function> is an unsupported table valued function for CDC reads.

DELTA_INVALID_TIMESTAMP_FORMAT

SQLSTATE: 22007

The provided timestamp <timestamp> does not match the expected syntax <format>.

DELTA_INVALID_V1_TABLE_CALL

SQLSTATE: XXKDS

<callVersion> call is not expected with path based <tableVersion>

DELTA_ITERATOR_ALREADY_CLOSED

SQLSTATE: XXKDS

Iterator is closed

DELTA_LOG_ALREADY_EXISTS

SQLSTATE: 42K04

A Delta log already exists at <path>

DELTA_LOG_FILE_NOT_FOUND_FOR_STREAMING_SOURCE

SQLSTATE: 42K03

If you never deleted it, it’s likely your query is lagging behind. Please delete its checkpoint to restart from scratch. To avoid this happening again, you can update your retention policy of your Delta table

DELTA_MAX_ARRAY_SIZE_EXCEEDED

SQLSTATE: 42000

Please use a limit less than Int.MaxValue - 8.

DELTA_MAX_COMMIT_RETRIES_EXCEEDED

SQLSTATE: 40000

This commit has failed as it has been tried <numAttempts> times but did not succeed.

This can be caused by the Delta table being committed continuously by many concurrent

commits.

Commit started at version: <startVersion>

Commit failed at version: <failVersion>

Number of actions attempted to commit: <numActions>

Total time spent attempting this commit: <timeSpent> ms

DELTA_MAX_LIST_FILE_EXCEEDED

SQLSTATE: 42000

File list must have at most <maxFileListSize> entries, had <numFiles>.

DELTA_MERGE_INCOMPATIBLE_DECIMAL_TYPE

SQLSTATE: 42806

Failed to merge decimal types with incompatible <decimalRanges>

DELTA_MERGE_MATERIALIZE_SOURCE_FAILED_REPEATEDLY

SQLSTATE: 25000

Keeping the source of the MERGE statement materialized has failed repeatedly.

DELTA_MERGE_MISSING_WHEN

SQLSTATE: 42601

There must be at least one WHEN clause in a MERGE statement.

DELTA_MERGE_UNEXPECTED_ASSIGNMENT_KEY

SQLSTATE: 22005

Unexpected assignment key: <unexpectedKeyClass> - <unexpectedKeyObject>

DELTA_METADATA_ABSENT

SQLSTATE: XXKDS

Couldn’t find Metadata while committing the first version of the Delta table.

DELTA_MISSING_CHANGE_DATA

SQLSTATE: KD002

Error getting change data for range [<startVersion> , <endVersion>] as change data was not

recorded for version [<version>]. If you’ve enabled change data feed on this table,

use DESCRIBE HISTORY to see when it was first enabled.

Otherwise, to start recording change data, use `ALTER TABLE table_name SET TBLPROPERTIES

(<key>=true)`.

DELTA_MISSING_COLUMN

SQLSTATE: 42703

Cannot find <columnName> in table columns: <columnList>

DELTA_MISSING_DELTA_TABLE

SQLSTATE: 42P01

<tableName> is not a Delta table.

DELTA_MISSING_FILES_UNEXPECTED_VERSION

SQLSTATE: XXKDS

The stream from your Delta table was expecting process data from version <startVersion>,

but the earliest available version in the deltalog directory is <earliestVersion>. The files

in the transaction log may have been deleted due to log cleanup. In order to avoid losing

data, we recommend that you restart your stream with a new checkpoint location and to

increase your delta.logRetentionDuration setting, if you have explicitly set it below 30

days.

If you would like to ignore the missed data and continue your stream from where it left

off, you can set the .option(“<option>”, “false”) as part

of your readStream statement.

DELTA_MISSING_ICEBERG_CLASS

SQLSTATE: 56038

Iceberg class was not found. Please ensure Delta Iceberg support is installed.

Please refer to <docLink> for more details.

DELTA_MISSING_NOT_NULL_COLUMN_VALUE

SQLSTATE: 23502

Column <columnName>, which has a NOT NULL constraint, is missing from the data being written into the table.

DELTA_MISSING_PARTITION_COLUMN

SQLSTATE: 42KD6

Partition column <columnName> not found in schema <columnList>

DELTA_MISSING_PART_FILES

SQLSTATE: 42KD6

Couldn’t find all part files of the checkpoint version: <version>

DELTA_MISSING_PROVIDER_FOR_CONVERT

SQLSTATE: 0AKDC

CONVERT TO DELTA only supports parquet tables. Please rewrite your target as parquet.<path> if it’s a parquet directory.

DELTA_MISSING_SET_COLUMN

SQLSTATE: 42703

SET column <columnName> not found given columns: <columnList>.

DELTA_MISSING_TRANSACTION_LOG

SQLSTATE: 42000

Incompatible format detected.

You are trying to <operation> <path> using Delta, but there is no

transaction log present. Check the upstream job to make sure that it is writing

using format(“delta”) and that you are trying to %1$s the table base path.

To learn more about Delta, see <docLink>

DELTA_MODE_NOT_SUPPORTED

SQLSTATE: 0AKDC

Specified mode ‘<mode>’ is not supported. Supported modes are: <supportedModes>

DELTA_MULTIPLE_CDC_BOUNDARY

SQLSTATE: 42614

Multiple <startingOrEnding> arguments provided for CDC read. Please provide one of either <startingOrEnding>Timestamp or <startingOrEnding>Version.

DELTA_MULTIPLE_CONF_FOR_SINGLE_COLUMN_IN_BLOOM_FILTER

SQLSTATE: 42614

Multiple bloom filter index configurations passed to command for column: <columnName>

DELTA_MULTIPLE_ROW_ID_HIGH_WATERMARKS_FOUND

SQLSTATE: 22000

Multiple Row ID high watermarks found for version <version>

DELTA_MULTIPLE_SOURCE_ROW_MATCHING_TARGET_ROW_IN_MERGE

SQLSTATE: 21506

Cannot perform Merge as multiple source rows matched and attempted to modify the same

target row in the Delta table in possibly conflicting ways. By SQL semantics of Merge,

when multiple source rows match on the same target row, the result may be ambiguous

as it is unclear which source row should be used to update or delete the matching

target row. You can preprocess the source table to eliminate the possibility of

multiple matches. Please refer to

<usageReference>

DELTA_NAME_CONFLICT_IN_BUCKETED_TABLE

SQLSTATE: 42000

The following column name(s) are reserved for Delta bucketed table internal usage only: <names>

DELTA_NESTED_FIELDS_NEED_RENAME

SQLSTATE: 42K05

Nested fields need renaming to avoid data loss. Fields:

<fields>.

Original schema:

<schema>

DELTA_NESTED_NOT_NULL_CONSTRAINT

SQLSTATE: 0AKDC

The <nestType> type of the field <parent> contains a NOT NULL constraint. Delta does not support NOT NULL constraints nested within arrays or maps. To suppress this error and silently ignore the specified constraints, set <configKey> = true.

Parsed <nestType> type:

<nestedPrettyJson>

DELTA_NESTED_SUBQUERY_NOT_SUPPORTED

SQLSTATE: 0A000

Nested subquery is not supported in the <operation> condition.

DELTA_NEW_CHECK_CONSTRAINT_VIOLATION

SQLSTATE: 23512

<numRows> rows in <tableName> violate the new CHECK constraint (<checkConstraint>)

DELTA_NEW_NOT_NULL_VIOLATION

SQLSTATE: 23512

<numRows> rows in <tableName> violate the new NOT NULL constraint on <colName>

DELTA_NON_BOOLEAN_CHECK_CONSTRAINT

SQLSTATE: 42621

CHECK constraint ‘<name>’ (<expr>) should be a boolean expression.

DELTA_NON_DETERMINISTIC_FUNCTION_NOT_SUPPORTED

SQLSTATE: 0AKDC

Non-deterministic functions are not supported in the <operation> <expression>

DELTA_NON_GENERATED_COLUMN_MISSING_UPDATE_EXPR

SQLSTATE: XXKDS

<columnName> is not a generated column but is missing its update expression

DELTA_NON_LAST_MATCHED_CLAUSE_OMIT_CONDITION

SQLSTATE: 42601

When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.

DELTA_NON_LAST_NOT_MATCHED_BY_SOURCE_CLAUSE_OMIT_CONDITION

SQLSTATE: 42601

When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.

DELTA_NON_LAST_NOT_MATCHED_CLAUSE_OMIT_CONDITION

SQLSTATE: 42601

When there are more than one NOT MATCHED clauses in a MERGE statement, only the last NOT MATCHED clause can omit the condition

DELTA_NON_PARSABLE_TAG

SQLSTATE: 42601

Could not parse tag <tag>.

File tags are: <tagList>

DELTA_NON_PARTITION_COLUMN_ABSENT

SQLSTATE: KD005

Data written into Delta needs to contain at least one non-partitioned column.<details>

DELTA_NON_PARTITION_COLUMN_REFERENCE

SQLSTATE: 42P10

Predicate references non-partition column ‘<columnName>’. Only the partition columns may be referenced: [<columnList>]

DELTA_NON_PARTITION_COLUMN_SPECIFIED

SQLSTATE: 42P10

Non-partitioning column(s) <columnList> are specified where only partitioning columns are expected: <fragment>.

DELTA_NON_SINGLE_PART_NAMESPACE_FOR_CATALOG

SQLSTATE: 42K05

Delta catalog requires a single-part namespace, but <identifier> is multi-part.

DELTA_NOT_A_DATABRICKS_DELTA_TABLE

SQLSTATE: 42000

<table> is not a Delta table. Please drop this table first if you would like to create it with Databricks Delta.

DELTA_NOT_A_DELTA_TABLE

SQLSTATE: 0AKDD

<tableName> is not a Delta table. Please drop this table first if you would like to recreate it with Delta Lake.

DELTA_NOT_NULL_COLUMN_NOT_FOUND_IN_STRUCT

SQLSTATE: 42K09

Not nullable column not found in struct: <struct>

DELTA_NOT_NULL_CONSTRAINT_VIOLATED

SQLSTATE: 23502

NOT NULL constraint violated for column: <columnName>.

DELTA_NOT_NULL_NESTED_FIELD

SQLSTATE: 0A000

A non-nullable nested field can’t be added to a nullable parent. Please set the nullability of the parent column accordingly.

DELTA_NO_COMMITS_FOUND

SQLSTATE: KD006

No commits found at <logPath>

DELTA_NO_NEW_ATTRIBUTE_ID

SQLSTATE: XXKDS

Could not find a new attribute ID for column <columnName>. This should have been checked earlier.

DELTA_NO_RECREATABLE_HISTORY_FOUND

SQLSTATE: KD006

No recreatable commits found at <logPath>

DELTA_NO_RELATION_TABLE

SQLSTATE: 42P01

Table <tableIdent> not found

DELTA_NO_START_FOR_CDC_READ

SQLSTATE: 42601

No startingVersion or startingTimestamp provided for CDC read.

DELTA_NULL_SCHEMA_IN_STREAMING_WRITE

SQLSTATE: 42P18

Delta doesn’t accept NullTypes in the schema for streaming writes.

DELTA_ONEOF_IN_TIMETRAVEL

SQLSTATE: 42601

Please either provide ‘timestampAsOf’ or ‘versionAsOf’ for time travel.

DELTA_ONLY_OPERATION

SQLSTATE: 0AKDD

<operation> is only supported for Delta tables.

DELTA_OPERATION_MISSING_PATH

SQLSTATE: 42601

Please provide the path or table identifier for <operation>.

DELTA_OPERATION_NOT_ALLOWED

SQLSTATE: 0AKDC

Operation not allowed: <operation> is not supported for Delta tables

DELTA_OPERATION_NOT_ALLOWED_DETAIL

SQLSTATE: 0AKDC

Operation not allowed: <operation> is not supported for Delta tables: <tableName>

DELTA_OPERATION_ON_TEMP_VIEW_WITH_GENERATED_COLS_NOT_SUPPORTED

SQLSTATE: 0A000

<operation> command on a temp view referring to a Delta table that contains generated columns is not supported. Please run the <operation> command on the Delta table directly

DELTA_OVERWRITE_MUST_BE_TRUE

SQLSTATE: 42000

Copy option overwriteSchema cannot be specified without setting OVERWRITE = ‘true’.

DELTA_PARTITION_COLUMN_CAST_FAILED

SQLSTATE: 22525

Failed to cast value <value> to <dataType> for partition column <columnName>

DELTA_PARTITION_COLUMN_NOT_FOUND

SQLSTATE: 42703

Partition column <columnName> not found in schema [<schemaMap>]

DELTA_PARTITION_SCHEMA_IN_ICEBERG_TABLES

SQLSTATE: 42613

Partition schema cannot be specified when converting Iceberg tables. It is automatically inferred.

DELTA_PATH_DOES_NOT_EXIST

SQLSTATE: 42K03

<path> doesn’t exist

DELTA_PATH_EXISTS

SQLSTATE: 42K04

Cannot write to already existent path <path> without setting OVERWRITE = ‘true’.

DELTA_PHYSICAL_ROW_ID_COLUMN_NAME_MISSING

SQLSTATE: 22000

Physical Row ID column name missing for <tableName>.

DELTA_POST_COMMIT_HOOK_FAILED

SQLSTATE: 2DKD0

Committing to the Delta table version <version> succeeded but error while executing post-commit hook <name>``<message>

DELTA_PROTOCOL_PROPERTY_NOT_INT

SQLSTATE: 42K06

Protocol property <key> needs to be an integer. Found <value>

DELTA_READ_FEATURE_PROTOCOL_REQUIRES_WRITE

SQLSTATE: KD004

Unable to upgrade only the reader protocol version to use table features. Writer protocol version must be at least <writerVersion> to proceed. Refer to <docLink> for more information on table protocol versions.

DELTA_READ_TABLE_WITHOUT_COLUMNS

SQLSTATE: 428GU

You are trying to read a Delta table <tableName> that does not have any columns.

Write some new data with the option mergeSchema = true to be able to read the table.

DELTA_REGEX_OPT_SYNTAX_ERROR

SQLSTATE: 2201B

Please recheck your syntax for ‘<regExpOption>

DELTA_REMOVE_FILE_CDC_MISSING_EXTENDED_METADATA

SQLSTATE: XXKDS

RemoveFile created without extended metadata is ineligible for CDC:

<file>

DELTA_REPLACE_WHERE_IN_OVERWRITE

SQLSTATE: 42613

You can’t use replaceWhere in conjunction with an overwrite by filter

DELTA_REPLACE_WHERE_MISMATCH

SQLSTATE: 44000

Data written out does not match replaceWhere ‘<replaceWhere>’.

<message>

DELTA_REPLACE_WHERE_WITH_DYNAMIC_PARTITION_OVERWRITE

SQLSTATE: 42613

A ‘replaceWhere’ expression and ‘partitionOverwriteMode’=’dynamic’ cannot both be set in the DataFrameWriter options.

DELTA_REPLACE_WHERE_WITH_FILTER_DATA_CHANGE_UNSET

SQLSTATE: 42613

‘replaceWhere’ cannot be used with data filters when ‘dataChange’ is set to false. Filters: <dataFilters>

DELTA_SCHEMA_CHANGED

SQLSTATE: KD007

Detected schema change:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory.

DELTA_SCHEMA_CHANGED_WITH_STARTING_OPTIONS

SQLSTATE: KD007

Detected schema change in version <version>:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory. If the issue persists after

changing to a new checkpoint directory, you may need to change the existing

‘startingVersion’ or ‘startingTimestamp’ option to start from a version newer than

<version> with a new checkpoint directory.

DELTA_SCHEMA_CHANGED_WITH_VERSION

SQLSTATE: KD007

Detected schema change in version <version>:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory.

DELTA_SCHEMA_CHANGE_SINCE_ANALYSIS

SQLSTATE: KD007

The schema of your Delta table has changed in an incompatible way since your DataFrame

or DeltaTable object was created. Please redefine your DataFrame or DeltaTable object.

Changes:

<schemaDiff>``<legacyFlagMessage>

DELTA_SCHEMA_NOT_CONSISTENT_WITH_TARGET

SQLSTATE: XXKDS

The table schema <tableSchema> is not consistent with the target attributes: <targetAttrs>

DELTA_SCHEMA_NOT_PROVIDED

SQLSTATE: 42908

Table schema is not provided. Please provide the schema (column definition) of the table when using REPLACE table and an AS SELECT query is not provided.

DELTA_SCHEMA_NOT_SET

SQLSTATE: KD008

Table schema is not set. Write data into it or use CREATE TABLE to set the schema.

DELTA_SET_LOCATION_SCHEMA_MISMATCH

SQLSTATE: 42KD7

The schema of the new Delta location is different than the current table schema.

original schema:

<original>

destination schema:

<destination>

If this is an intended change, you may turn this check off by running:

%%sql set <config> = true

DELTA_SHALLOW_CLONE_FILE_NOT_FOUND

SQLSTATE: 42K03

File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This table appears to be a shallow clone, if that is the case, this error can occur when the original table from which this table was cloned has deleted a file that the clone is still using. If you want any clones to be independent of the original table, use a DEEP clone instead.

DELTA_SHOW_PARTITION_IN_NON_PARTITIONED_COLUMN

SQLSTATE: 42P10

Non-partitioning column(s) <badCols> are specified for SHOW PARTITIONS

DELTA_SHOW_PARTITION_IN_NON_PARTITIONED_TABLE

SQLSTATE: 42809

SHOW PARTITIONS is not allowed on a table that is not partitioned: <tableName>

DELTA_SOURCE_IGNORE_DELETE

SQLSTATE: 0A000

Detected deleted data (for example <removedFile>) from streaming source at version <version>. This is currently not supported. If you’d like to ignore deletes, set the option ‘ignoreDeletes’ to ‘true’. The source table can be found at path <dataPath>.

DELTA_SOURCE_TABLE_IGNORE_CHANGES

SQLSTATE: 0A000

Detected a data update (for example <file>) in the source table at version <version>. This is currently not supported. If you’d like to ignore updates, set the option ‘skipChangeCommits’ to ‘true’. If you would like the data update to be reflected, please restart this query with a fresh checkpoint directory. The source table can be found at path <dataPath>.

DELTA_SPARK_SESSION_NOT_SET

SQLSTATE: XXKDS

Active SparkSession not set.

DELTA_SPARK_THREAD_NOT_FOUND

SQLSTATE: XXKDS

Not running on a Spark task thread

DELTA_STARTING_VERSION_AND_TIMESTAMP_BOTH_SET

SQLSTATE: 42613

Please either provide ‘<version>’ or ‘<timestamp>

DELTA_STATE_RECOVER_ERROR

SQLSTATE: XXKDS

The <operation> of your Delta table could not be recovered while Reconstructing

version: <version>. Did you manually delete files in the deltalog directory?

DELTA_STATS_COLLECTION_COLUMN_NOT_FOUND

SQLSTATE: 42000

<statsType> stats not found for column in Parquet metadata: <columnPath>.

DELTA_STREAMING_CANNOT_CONTINUE_PROCESSING_POST_SCHEMA_EVOLUTION

SQLSTATE: KD002

We’ve detected a non-additive schema change (<opType>) at Delta version <schemaChangeVersion> in the Delta streaming source. Please check if you want to manually propagate this schema change to the sink table before we proceed with stream processing.

Once you have fixed the schema of the sink table or have decided there is no need to fix, you can set (one of) the following SQL configurations to unblock this non-additive schema change and continue stream processing.

To unblock for this particular stream just for this single schema change: set <allowCkptVerKey>` = `<allowCkptVerValue>.

To unblock for this particular stream: set <allowCkptKey>` = `<allowCkptValue>

To unblock for all streams: set <allowAllKey>` = `<allowAllValue>.

Alternatively if applicable, you may replace the <allowAllMode> with <opSpecificMode> in the SQL conf to unblock stream for just this schema change type.

DELTA_STREAMING_CHECK_COLUMN_MAPPING_NO_SNAPSHOT

SQLSTATE: KD002

Failed to obtain Delta log snapshot for the start version when checking column mapping schema changes. Please choose a different start version, or force enable streaming read at your own risk by setting ‘<config>’ to ‘true’.

DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE

SQLSTATE: 42KD4

Streaming read is not supported on tables with read-incompatible schema changes (e.g. rename or drop or datatype changes).

For further information and possible next steps to resolve this issue, please review the documentation at <docLink>

Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.

DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE_USE_SCHEMA_LOG

SQLSTATE: 42KD4

Streaming read is not supported on tables with read-incompatible schema changes (e.g. rename or drop or datatype changes).

Please provide a ‘schemaTrackingLocation’ to enable non-additive schema evolution for Delta stream processing.

See <docLink> for more details.

Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.

DELTA_STREAMING_SCHEMA_EVOLUTION

SQLSTATE: 22000

The schema of your Delta table has changed during streaming, and the schema tracking log has been updated

Please restart the stream to continue processing using the updated schema: <schema>

DELTA_STREAMING_SCHEMA_LOCATION_CONFLICT

SQLSTATE: 22000

Detected conflicting schema location ‘<loc>’ while streaming from table or table located at ‘<table>’.

Another stream may be reusing the same schema location, which is not allowed.

Please provide a new unique schemaTrackingLocation path or streamingSourceTrackingId as a reader option for one of the streams from this table.

DELTA_STREAMING_SCHEMA_LOCATION_NOT_UNDER_CHECKPOINT

SQLSTATE: 22000

Schema location ‘<schemaTrackingLocation>’ must be placed under checkpoint location ‘<checkpointLocation>’.

DELTA_STREAMING_SCHEMA_LOG_DESERIALIZE_FAILED

SQLSTATE: 22000

Incomplete log file in the Delta streaming source schema log at ‘<location>’.

The schema log may have been corrupted. Please pick a new schema location.

DELTA_STREAMING_SCHEMA_LOG_INCOMPATIBLE_DELTA_TABLE_ID

SQLSTATE: 22000

Detected incompatible Delta table id when trying to read Delta stream.

Persisted table id: <persistedId>, Table id: <tableId>

The schema log might have been reused. Please pick a new schema location.

DELTA_STREAMING_SCHEMA_LOG_INCOMPATIBLE_PARTITION_SCHEMA

SQLSTATE: 22000

Detected incompatible partition schema when trying to read Delta stream.

Persisted schema: <persistedSchema>, Delta partition schema: <partitionSchema>

Please pick a new schema location to reinitialize the schema log if you have manually changed the table’s partition schema recently.

DELTA_STREAMING_SCHEMA_LOG_INIT_FAILED_INCOMPATIBLE_SCHEMA

SQLSTATE: 22000

We could not initialize the Delta streaming source schema log with a valid schema because

we detected an incompatible schema change while serving a streaming batch from table version <a> to <b>.

To continue processing the stream with latest schema, please turn on <config>.

DELTA_STREAMING_SCHEMA_LOG_PARSE_SCHEMA_FAILED

SQLSTATE: 22000

Failed to parse the schema from the Delta streaming source schema log.

The schema log may have been corrupted. Please pick a new schema location.

DELTA_TABLE_ALREADY_CONTAINS_CDC_COLUMNS

SQLSTATE: 42711

Unable to enable Change Data Capture on the table. The table already contains

reserved columns <columnList> that will

be used internally as metadata for the table’s Change Data Feed. To enable

Change Data Feed on the table rename/drop these columns.

DELTA_TABLE_ALREADY_EXISTS

SQLSTATE: 42P07

Table <tableName> already exists.

DELTA_TABLE_FOR_PATH_UNSUPPORTED_HADOOP_CONF

SQLSTATE: 0AKDC

Currently DeltaTable.forPath only supports hadoop configuration keys starting with <allowedPrefixes> but got <unsupportedOptions>

DELTA_TABLE_FOUND_IN_EXECUTOR

SQLSTATE: XXKDS

DeltaTable cannot be used in executors

DELTA_TABLE_LOCATION_MISMATCH

SQLSTATE: 42613

The location of the existing table <tableName> is <existingTableLocation>. It doesn’t match the specified location <tableLocation>.

DELTA_TABLE_NOT_FOUND

SQLSTATE: 42P01

Delta table <tableName> doesn’t exist.

DELTA_TABLE_NOT_FOUND_STREAMING

SQLSTATE: 42P01

Delta table <tableName> doesn’t exist. Please delete your streaming query checkpoint and restart.

DELTA_TABLE_NOT_SUPPORTED_IN_OP

SQLSTATE: 42809

Table is not supported in <operation>. Please use a path instead.

DELTA_TABLE_ONLY_OPERATION

SQLSTATE: 0AKDD

<tableName> is not a Delta table. <operation> is only supported for Delta tables.

DELTA_TARGET_TABLE_FINAL_SCHEMA_EMPTY

SQLSTATE: 428GU

Target table final schema is empty.

DELTA_TIMESTAMP_GREATER_THAN_COMMIT

SQLSTATE: 42816

The provided timestamp (<providedTimestamp>) is after the latest version available to this

table (<tableName>). Please use a timestamp before or at <maximumTimestamp>.

DELTA_TIMESTAMP_INVALID

SQLSTATE: 42816

The provided timestamp (<expr>) cannot be converted to a valid timestamp.

DELTA_TIME_TRAVEL_INVALID_BEGIN_VALUE

SQLSTATE: 42604

<timeTravelKey> needs to be a valid begin value.

DELTA_TRUNCATED_TRANSACTION_LOG

SQLSTATE: 42K03

<path>: Unable to reconstruct state at version <version> as the transaction log has been truncated due to manual deletion or the log retention policy (<logRetentionKey>=<logRetention>) and checkpoint retention policy (<checkpointRetentionKey>=<checkpointRetention>)

DELTA_TRUNCATE_TABLE_PARTITION_NOT_SUPPORTED

SQLSTATE: 0AKDC

Operation not allowed: TRUNCATE TABLE on Delta tables does not support partition predicates; use DELETE to delete specific partitions or rows.

DELTA_TXN_LOG_FAILED_INTEGRITY

SQLSTATE: XXKDS

The transaction log has failed integrity checks. Failed verification at version <version> of:

<mismatchStringOpt>

DELTA_UDF_IN_GENERATED_COLUMN

SQLSTATE: 42621

Found <udfExpr>. A generated column cannot use a user-defined function

DELTA_UNEXPECTED_ACTION_EXPRESSION

SQLSTATE: 42601

Unexpected action expression <expression>.

DELTA_UNEXPECTED_ACTION_IN_OPTIMIZE

SQLSTATE: XXKDS

Unexpected action <action> with type <actionClass>. Optimize should only have AddFiles and RemoveFiles.

DELTA_UNEXPECTED_ALIAS

SQLSTATE: XXKDS

Expected Alias but got <alias>

DELTA_UNEXPECTED_ATTRIBUTE_REFERENCE

SQLSTATE: XXKDS

Expected AttributeReference but got <ref>

DELTA_UNEXPECTED_CHANGE_FILES_FOUND

SQLSTATE: XXKDS

Change files found in a dataChange = false transaction. Files:

<fileList>

DELTA_UNEXPECTED_NUM_PARTITION_COLUMNS_FROM_FILE_NAME

SQLSTATE: KD009

Expecting <expectedColsSize> partition column(s): <expectedCols>, but found <parsedColsSize> partition column(s): <parsedCols> from parsing the file name: <path>

DELTA_UNEXPECTED_PARTIAL_SCAN

SQLSTATE: KD00A

Expect a full scan of Delta sources, but found a partial scan. path:<path>

DELTA_UNEXPECTED_PARTITION_COLUMN_FROM_FILE_NAME

SQLSTATE: KD009

Expecting partition column <expectedCol>, but found partition column <parsedCol> from parsing the file name: <path>

DELTA_UNEXPECTED_PARTITION_SCHEMA_FROM_USER

SQLSTATE: KD009

CONVERT TO DELTA was called with a partition schema different from the partition schema inferred from the catalog, please avoid providing the schema so that the partition schema can be chosen from the catalog.

catalog partition schema:

<catalogPartitionSchema>

provided partition schema:

<userPartitionSchema>

DELTA_UNEXPECTED_PROJECT

SQLSTATE: XXKDS

Expected Project but got <project>

DELTA_UNKNOWN_CONFIGURATION

SQLSTATE: F0000

Unknown configuration was specified: <config>

DELTA_UNKNOWN_PRIVILEGE

SQLSTATE: 42601

Unknown privilege: <privilege>

DELTA_UNKNOWN_READ_LIMIT

SQLSTATE: 42601

Unknown ReadLimit: <limit>

DELTA_UNRECOGNIZED_COLUMN_CHANGE

SQLSTATE: 42601

Unrecognized column change <otherClass>. You may be running an out-of-date Delta Lake version.

DELTA_UNRECOGNIZED_FILE_ACTION

SQLSTATE: XXKDS

Unrecognized file action <action> with type <actionClass>.

DELTA_UNRECOGNIZED_INVARIANT

SQLSTATE: 56038

Unrecognized invariant. Please upgrade your Spark version.

DELTA_UNRECOGNIZED_LOGFILE

SQLSTATE: KD00B

Unrecognized log file <fileName>

DELTA_UNSET_NON_EXISTENT_PROPERTY

SQLSTATE: 42616

Attempted to unset non-existent property ‘<property>’ in table <tableName>

DELTA_UNSUPPORTED_ABS_PATH_ADD_FILE

SQLSTATE: 0AKDC

<path> does not support adding files with an absolute path

DELTA_UNSUPPORTED_ALTER_TABLE_REPLACE_COL_OP

SQLSTATE: 0AKDC

Unsupported ALTER TABLE REPLACE COLUMNS operation. Reason: <details>

Failed to change schema from:

<oldSchema>

to:

<newSchema>

DELTA_UNSUPPORTED_CLONE_REPLACE_SAME_TABLE

SQLSTATE: 0AKDC

You tried to REPLACE an existing table (<tableName>) with CLONE. This operation is

unsupported. Try a different target for CLONE or delete the table at the current target.

DELTA_UNSUPPORTED_COLUMN_MAPPING_MODE_CHANGE

SQLSTATE: 0AKDC

Changing column mapping mode from ‘<oldMode>’ to ‘<newMode>’ is not supported.

DELTA_UNSUPPORTED_COLUMN_MAPPING_PROTOCOL

SQLSTATE: KD004

Your current table protocol version does not support changing column mapping modes

using <config>.

Required Delta protocol version for column mapping:

<requiredVersion>

Your table’s current Delta protocol version:

<currentVersion>

<advice>

DELTA_UNSUPPORTED_COLUMN_MAPPING_SCHEMA_CHANGE

SQLSTATE: 0AKDC

Schema change is detected:

old schema:

<oldTableSchema>

new schema:

<newTableSchema>

Schema changes are not allowed during the change of column mapping mode.

DELTA_UNSUPPORTED_COLUMN_MAPPING_WRITE

SQLSTATE: 0AKDC

Writing data with column mapping mode is not supported.

DELTA_UNSUPPORTED_COLUMN_TYPE_IN_BLOOM_FILTER

SQLSTATE: 0AKDC

Creating a bloom filter index on a column with type <dataType> is unsupported: <columnName>

DELTA_UNSUPPORTED_DATA_TYPES

SQLSTATE: 0AKDC

Found columns using unsupported data types: <dataTypeList>. You can set ‘<config>’ to ‘false’ to disable the type check. Disabling this type check may allow users to create unsupported Delta tables and should only be used when trying to read/write legacy tables.

DELTA_UNSUPPORTED_DEEP_CLONE

SQLSTATE: 0A000

Deep clone is not supported for this Delta version.

DELTA_UNSUPPORTED_DESCRIBE_DETAIL_VIEW

SQLSTATE: 42809

<view> is a view. DESCRIBE DETAIL is only supported for tables.

DELTA_UNSUPPORTED_DROP_COLUMN

SQLSTATE: 0AKDC

DROP COLUMN is not supported for your Delta table. <advice>

DELTA_UNSUPPORTED_DROP_NESTED_COLUMN_FROM_NON_STRUCT_TYPE

SQLSTATE: 0AKDC

Can only drop nested columns from StructType. Found <struct>

DELTA_UNSUPPORTED_DROP_PARTITION_COLUMN

SQLSTATE: 0AKDC

Dropping partition columns (<columnList>) is not allowed.

DELTA_UNSUPPORTED_EXPRESSION

SQLSTATE: 0A000

Unsupported expression type(<expType>) for <causedBy>. The supported types are [<supportedTypes>].

DELTA_UNSUPPORTED_EXPRESSION_GENERATED_COLUMN

SQLSTATE: 42621

<expression> cannot be used in a generated column

DELTA_UNSUPPORTED_FEATURES_FOR_READ

SQLSTATE: 56038

Unable to read this table because it requires reader table feature(s) that are unsupported by this version of Databricks: <unsupported>.

DELTA_UNSUPPORTED_FEATURES_FOR_WRITE

SQLSTATE: 56038

Unable to write this table because it requires writer table feature(s) that are unsupported by this version of Databricks: <unsupported>.

DELTA_UNSUPPORTED_FEATURES_IN_CONFIG

SQLSTATE: 56038

Table feature(s) configured in the following Spark configs or Delta table properties are not recognized by this version of Databricks: <configs>.

DELTA_UNSUPPORTED_FEATURE_STATUS

SQLSTATE: 0AKDE

Expecting the status for table feature <feature> to be “supported”, but got “<status>”.

DELTA_UNSUPPORTED_FIELD_UPDATE_NON_STRUCT

SQLSTATE: 0AKDC

Updating nested fields is only supported for StructType, but you are trying to update a field of <columnName>, which is of type: <dataType>.

DELTA_UNSUPPORTED_FSCK_WITH_DELETION_VECTORS

SQLSTATE: 0A000

The ‘FSCK REPAIR TABLE’ command is not supported on table versions with missing deletion vector files.

Please contact support.

DELTA_UNSUPPORTED_GENERATE_WITH_DELETION_VECTORS

SQLSTATE: 0A000

The ‘GENERATE symlink_format_manifest’ command is not supported on table versions with deletion vectors.

In order to produce a version of the table without deletion vectors, run ‘REORG TABLE table APPLY (PURGE)’. Then re-run the ‘GENERATE’ command.

Make sure that no concurrent transactions are adding deletion vectors again between REORG and GENERATE.

If you need to generate manifests regularly, or you cannot prevent concurrent transactions, consider disabling deletion vectors on this table using ‘ALTER TABLE table SET TBLPROPERTIES (delta.enableDeletionVectors = false)’.

DELTA_UNSUPPORTED_INVARIANT_NON_STRUCT

SQLSTATE: 0AKDC

Invariants on nested fields other than StructTypes are not supported.

DELTA_UNSUPPORTED_IN_SUBQUERY

SQLSTATE: 0AKDC

In subquery is not supported in the <operation> condition.

DELTA_UNSUPPORTED_LIST_KEYS_WITH_PREFIX

SQLSTATE: 0A000

listKeywithPrefix not available

DELTA_UNSUPPORTED_MANIFEST_GENERATION_WITH_COLUMN_MAPPING

SQLSTATE: 0AKDC

Manifest generation is not supported for tables that leverage column mapping, as external readers cannot read these Delta tables. See Delta documentation for more details.

DELTA_UNSUPPORTED_MERGE_SCHEMA_EVOLUTION_WITH_CDC

SQLSTATE: 0A000

MERGE INTO operations with schema evolution do not currently support writing CDC output.

DELTA_UNSUPPORTED_MULTI_COL_IN_PREDICATE

SQLSTATE: 0AKDC

Multi-column In predicates are not supported in the <operation> condition.

DELTA_UNSUPPORTED_NESTED_COLUMN_IN_BLOOM_FILTER

SQLSTATE: 0AKDC

Creating a bloom filer index on a nested column is currently unsupported: <columnName>

DELTA_UNSUPPORTED_NESTED_FIELD_IN_OPERATION

SQLSTATE: 0AKDC

Nested field is not supported in the <operation> (field = <fieldName>).

DELTA_UNSUPPORTED_NON_EMPTY_CLONE

SQLSTATE: 0AKDC

The clone destination table is non-empty. Please TRUNCATE or DELETE FROM the table before running CLONE.

DELTA_UNSUPPORTED_OUTPUT_MODE

SQLSTATE: 0AKDC

Data source <dataSource> does not support <mode> output mode

DELTA_UNSUPPORTED_PARTITION_COLUMN_IN_BLOOM_FILTER

SQLSTATE: 0AKDC

Creating a bloom filter index on a partitioning column is unsupported: <columnName>

DELTA_UNSUPPORTED_RENAME_COLUMN

SQLSTATE: 0AKDC

Column rename is not supported for your Delta table. <advice>

DELTA_UNSUPPORTED_SCHEMA_DURING_READ

SQLSTATE: 0AKDC

Delta does not support specifying the schema at read time.

DELTA_UNSUPPORTED_SORT_ON_BUCKETED_TABLES

SQLSTATE: 0A000

SORTED BY is not supported for Delta bucketed tables

DELTA_UNSUPPORTED_SOURCE

SQLSTATE: 0AKDD

<operation> destination only supports Delta sources.

<plan>

DELTA_UNSUPPORTED_STATIC_PARTITIONS

SQLSTATE: 0AKDD

Specifying static partitions in the partition spec is currently not supported during inserts

DELTA_UNSUPPORTED_STRATEGY_NAME

SQLSTATE: 22023

Unsupported strategy name: <strategy>

DELTA_UNSUPPORTED_SUBQUERY

SQLSTATE: 0AKDC

Subqueries are not supported in the <operation> (condition = <cond>).

DELTA_UNSUPPORTED_SUBQUERY_IN_PARTITION_PREDICATES

SQLSTATE: 0AKDC

Subquery is not supported in partition predicates.

DELTA_UNSUPPORTED_TIME_TRAVEL_MULTIPLE_FORMATS

SQLSTATE: 42613

Cannot specify time travel in multiple formats.

DELTA_UNSUPPORTED_TIME_TRAVEL_VIEWS

SQLSTATE: 0AKDC

Cannot time travel views, subqueries, streams or change data feed queries.

DELTA_UNSUPPORTED_TRUNCATE_SAMPLE_TABLES

SQLSTATE: 0A000

Truncate sample tables is not supported

DELTA_UNSUPPORTED_TYPE_TIMESTAMP_NTZ

SQLSTATE: 0A000

Your table schema <schema> contains a column of type TimestampNTZ.

TimestampNTZ type is not supported by your table’s protocol.

Required Delta protocol version and features for TimestampNTZ:

<requiredVersion>

Your table’s current Delta protocol version and enabled features:

<currentVersion>

Run the following command to add TimestampNTZ support to your table.

ALTER TABLE table_name SET TBLPROPERTIES (‘delta.feature.timestampNtz’ = ‘supported’)

DELTA_UNSUPPORTED_VACUUM_SPECIFIC_PARTITION

SQLSTATE: 0AKDC

Please provide the base path (<baseDeltaPath>) when Vacuuming Delta tables. Vacuuming specific partitions is currently not supported.

DELTA_UNSUPPORTED_WRITES_STAGED_TABLE

SQLSTATE: 42807

Table implementation does not support writes: <tableName>

DELTA_UNSUPPORTED_WRITE_SAMPLE_TABLES

SQLSTATE: 0A000

Write to sample tables is not supported

DELTA_UPDATE_SCHEMA_MISMATCH_EXPRESSION

SQLSTATE: 42846

Cannot cast <fromCatalog> to <toCatalog>. All nested columns must match.

DELTA_VERSIONS_NOT_CONTIGUOUS

SQLSTATE: KD00C

Versions (<versionList>) are not contiguous.

For more details see DELTA_VERSIONS_NOT_CONTIGUOUS

DELTA_VIOLATE_CONSTRAINT_WITH_VALUES

SQLSTATE: 23001

CHECK constraint <constraintName> <expression> violated by row with values:

<values>

DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED

SQLSTATE: 0A000

The validation of the properties of table <table> has been violated:

For more details see DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED

DELTA_WRITE_INTO_VIEW_NOT_SUPPORTED

SQLSTATE: 0A000

<viewIdentifier> is a view. You may not write data into a view.

DELTA_ZORDERING_COLUMN_DOES_NOT_EXIST

SQLSTATE: 42703

Z-Ordering column <columnName> does not exist in data schema.

DELTA_ZORDERING_ON_COLUMN_WITHOUT_STATS

SQLSTATE: KD00D

Z-Ordering on <cols> will be

ineffective, because we currently do not collect stats for these columns. Please refer to

<link>

for more information on data skipping and z-ordering. You can disable

this check by setting

‘%%sql set <zorderColStatKey> = false’

DELTA_ZORDERING_ON_PARTITION_COLUMN

SQLSTATE: 42P10

<colName> is a partition column. Z-Ordering can only be performed on data columns

Autoloader

CF_ADD_NEW_NOT_SUPPORTED

SQLSTATE: 0A000

Schema evolution mode <addNewColumnsMode> is not supported when the schema is specified. To use this mode, you can provide the schema through cloudFiles.schemaHints instead.

CF_AMBIGUOUS_AUTH_OPTIONS_ERROR

SQLSTATE: 42000

Found notification-setup authentication options for the (default) directory

listing mode:

<options>

If you wish to use the file notification mode, please explicitly set:

.option(“cloudFiles.<useNotificationsKey>”, “true”)

Alternatively, if you want to skip the validation of your options and ignore these

authentication options, you can set:

.option(“cloudFiles.ValidateOptionsKey>”, “false”)

CF_AMBIGUOUS_INCREMENTAL_LISTING_MODE_ERROR

SQLSTATE: 42000

Incremental listing mode (cloudFiles.<useIncrementalListingKey>)

and file notification (cloudFiles.<useNotificationsKey>)

have been enabled at the same time.

Please make sure that you select only one.

CF_AZURE_STORAGE_SUFFIXES_REQUIRED

SQLSTATE: 42000

Require adlsBlobSuffix and adlsDfsSuffix for Azure

CF_BUCKET_MISMATCH

SQLSTATE: 22000

The <storeType> in the file event <fileEvent> is different from expected by the source: <source>.

CF_CANNOT_EVOLVE_SCHEMA_LOG_EMPTY

SQLSTATE: 22000

Cannot evolve schema when the schema log is empty. Schema log location: <logPath>

CF_CANNOT_RESOLVE_CONTAINER_NAME

SQLSTATE: 22000

Cannot resolve container name from path: <path>, Resolved uri: <uri>

CF_CANNOT_RUN_DIRECTORY_LISTING

SQLSTATE: 22000

Cannot run directory listing when there is an async backfill thread running

CF_CLEAN_SOURCE_ALLOW_OVERWRITES_BOTH_ON

SQLSTATE: 42000

Cannot turn on cloudFiles.cleanSource and cloudFiles.allowOverwrites at the same time.

CF_CLEAN_SOURCE_UNAUTHORIZED_WRITE_PERMISSION

SQLSTATE: 42501

Auto Loader cannot delete processed files because it does not have write permissions to the source directory.

<reason>

To fix you can either:

  1. Grant write permissions to the source directory OR

  2. Set cleanSource to ‘OFF’

You could also unblock your stream by setting the SQLConf spark.databricks.cloudFiles.cleanSource.disabledDueToAuthorizationErrors to ‘true’.

CF_DUPLICATE_COLUMN_IN_DATA

SQLSTATE: 22000

There was an error when trying to infer the partition schema of your table. You have the same column duplicated in your data and partition paths. To ignore the partition value, please provide your partition columns explicitly by using: .option(“cloudFiles.<partitionColumnsKey>”, “{comma-separated-list}”)

CF_EMPTY_DIR_FOR_SCHEMA_INFERENCE

SQLSTATE: 42000

Cannot infer schema when the input path <path> is empty. Please try to start the stream when there are files in the input path, or specify the schema.

CF_EVENT_GRID_AUTH_ERROR

SQLSTATE: 22000

Failed to create an Event Grid subscription. Please make sure that your service

principal has <permissionType> Event Grid Subscriptions. See more details at:

<docLink>

CF_EVENT_GRID_CREATION_FAILED

SQLSTATE: 22000

Failed to create event grid subscription. Please ensure that Microsoft.EventGrid is

registered as resource provider in your subscription. See more details at:

<docLink>

CF_EVENT_GRID_NOT_FOUND_ERROR

SQLSTATE: 22000

Failed to create an Event Grid subscription. Please make sure that your storage

account (<storageAccount>) is under your resource group (<resourceGroup>) and that

the storage account is a “StorageV2 (general purpose v2)” account. See more details at:

<docLink>

CF_EVENT_NOTIFICATION_NOT_SUPPORTED

SQLSTATE: 0A000

Auto Loader event notification mode is not supported for <cloudStore>.

CF_FAILED_TO_CHECK_STREAM_NEW

SQLSTATE: 22000

Failed to check if the stream is new

CF_FAILED_TO_CREATED_PUBSUB_SUBSCRIPTION

SQLSTATE: 22000

Failed to create subscription: <subscriptionName>. A subscription with the same name already exists and is associated with another topic: <otherTopicName>. The desired topic is <proposedTopicName>. Either delete the existing subscription or create a subscription with a new resource suffix.

CF_FAILED_TO_CREATED_PUBSUB_TOPIC

SQLSTATE: 22000

Failed to create topic: <topicName>. A topic with the same name already exists.<reason> Remove the existing topic or try again with another resource suffix

CF_FAILED_TO_DELETE_GCP_NOTIFICATION

SQLSTATE: 22000

Failed to delete notification with id <notificationId> on bucket <bucketName> for topic <topicName>. Please retry or manually remove the notification through the GCP console.

CF_FAILED_TO_DESERIALIZE_PERSISTED_SCHEMA

SQLSTATE: 22000

Failed to deserialize persisted schema from string: ‘<jsonSchema>

CF_FAILED_TO_EVOLVE_SCHEMA

SQLSTATE: 22000

Cannot evolve schema without a schema log.

CF_FAILED_TO_FIND_PROVIDER

SQLSTATE: 42000

Failed to find provider for <fileFormatInput>

CF_FAILED_TO_INFER_SCHEMA

SQLSTATE: 22000

Failed to infer schema for format <fileFormatInput> from existing files in input path <path>. Please ensure you configured the options properly or explicitly specify the schema.

CF_FAILED_TO_WRITE_TO_SCHEMA_LOG

SQLSTATE: 22000

Failed to write to the schema log at location <path>.

CF_FILE_FORMAT_REQUIRED

SQLSTATE: 42000

Could not find required option: cloudFiles.format.

CF_FOUND_MULTIPLE_AUTOLOADER_PUBSUB_SUBSCRIPTIONS

SQLSTATE: 22000

Found multiple (<num>) subscriptions with the Auto Loader prefix for topic <topicName>:

<subscriptionList>

There should only be one subscription per topic. Please manually ensure that your topic does not have multiple subscriptions.

CF_GCP_AUTHENTICATION

SQLSTATE: 42000

Please either provide all of the following: <clientEmail>, <client>,

<privateKey>, and <privateKeyId> or provide none of them in order to use the default

GCP credential provider chain for authenticating with GCP resources.

CF_GCP_LABELS_COUNT_EXCEEDED

SQLSTATE: 22000

Received too many labels (<num>) for GCP resource. The maximum label count per resource is <maxNum>.

CF_GCP_RESOURCE_TAGS_COUNT_EXCEEDED

SQLSTATE: 22000

Received too many resource tags (<num>) for GCP resource. The maximum resource tag count per resource is <maxNum>, as resource tags are stored as GCP labels on resources, and Databricks specific tags consume some of this label quota.

CF_INCOMPLETE_LOG_FILE_IN_SCHEMA_LOG

SQLSTATE: 22000

Incomplete log file in the schema log

CF_INCOMPLETE_METADATA_FILE_IN_CHECKPOINT

SQLSTATE: 22000

Incomplete metadata file in the Auto Loader checkpoint

CF_INCORRECT_SQL_PARAMS

SQLSTATE: 42000

The cloud_files method accepts two required string parameters: the path to load from, and the file format. File reader options must be provided in a string key-value map. e.g. cloud_files(“path”, “json”, map(“option1”, “value1”)). Received: <params>

CF_INVALID_ARN

SQLSTATE: 42000

Invalid ARN: <arn>

CF_INVALID_CHECKPOINT

SQLSTATE: 42000

This checkpoint is not a valid CloudFiles source

CF_INVALID_CLEAN_SOURCE_MODE

SQLSTATE: 42000

Invalid mode for clean source option <value>.

CF_INVALID_GCP_RESOURCE_TAG_KEY

SQLSTATE: 42000

Invalid resource tag key for GCP resource: <key>. Keys must start with a lowercase letter, be within 1 to 63 characters long, and contain only lowercase letters, numbers, underscores (_), and hyphens (-).

CF_INVALID_GCP_RESOURCE_TAG_VALUE

SQLSTATE: 42000

Invalid resource tag value for GCP resource: <value>. Values must be within 0 to 63 characters long and must contain only lowercase letters, numbers, underscores (_), and hyphens (-).

CF_INVALID_SCHEMA_EVOLUTION_MODE

SQLSTATE: 42000

cloudFiles.<schemaEvolutionModeKey> must be one of {

<addNewColumns>

<failOnNewColumns>

<rescue>

<noEvolution>”}

CF_INVALID_SCHEMA_HINTS_OPTION

SQLSTATE: 42000

Schema hints can only specify a particular column once.

In this case, redefining column: <columnName>

multiple times in schemaHints:

<schemaHints>

CF_INVALID_SCHEMA_HINT_COLUMN

SQLSTATE: 42000

Schema hints can not be used to override maps’ and arrays’ nested types.

Conflicted column: <columnName>

CF_LATEST_OFFSET_READ_LIMIT_REQUIRED

SQLSTATE: 22000

latestOffset should be called with a ReadLimit on this source.

CF_LOG_FILE_MALFORMED

SQLSTATE: 22000

Log file was malformed: failed to read correct log version from <fileName>.

CF_MAX_MUST_BE_POSITIVE

SQLSTATE: 42000

max must be positive

CF_METADATA_FILE_CONCURRENTLY_USED

SQLSTATE: 22000

Multiple streaming queries are concurrently using <metadataFile>

CF_MISSING_METADATA_FILE_ERROR

SQLSTATE: 42000

The metadata file in the streaming source checkpoint directory is missing. This metadata

file contains important default options for the stream, so the stream cannot be restarted

right now. Please contact Databricks support for assistance.

CF_MISSING_PARTITION_COLUMN_ERROR

SQLSTATE: 42000

Partition column <columnName> does not exist in the provided schema:

<schema>

CF_MISSING_SCHEMA_IN_PATHLESS_MODE

SQLSTATE: 42000

Please specify a schema using .schema() if a path is not provided to the CloudFiles source while using file notification mode. Alternatively, to have Auto Loader to infer the schema please provide a base path in .load().

CF_MULTIPLE_PUBSUB_NOTIFICATIONS_FOR_TOPIC

SQLSTATE: 22000

Found existing notifications for topic <topicName> on bucket <bucketName>:

notification,id

<notificationList>

To avoid polluting the subscriber with unintended events, please delete the above notifications and retry.

CF_NEW_PARTITION_ERROR

SQLSTATE: 22000

New partition columns were inferred from your files: [<filesList>]. Please provide all partition columns in your schema or provide a list of partition columns which you would like to extract values for by using: .option(“cloudFiles.partitionColumns”, “{comma-separated-list|empty-string}”)

CF_PARTITON_INFERENCE_ERROR

SQLSTATE: 22000

There was an error when trying to infer the partition schema of the current batch of files. Please provide your partition columns explicitly by using: .option(“cloudFiles.<partitionColumnOption>”, “{comma-separated-list}”)

CF_PATH_DOES_NOT_EXIST_FOR_SCHEMA_INFERENCE

SQLSTATE: 42000

Cannot infer schema when the input path <path> does not exist. Please make sure the input path exists and re-try.

CF_PERIODIC_BACKFILL_NOT_SUPPORTED

SQLSTATE: 0A000

Periodic backfill is not supported if asynchronous backfill is disabled. You can enable asynchronous backfill/directory listing by setting spark.databricks.cloudFiles.asyncDirListing to true

CF_PREFIX_MISMATCH

SQLSTATE: 22000

Found mismatched event: key <key> doesn’t have the prefix: <prefix>

CF_PROTOCOL_MISMATCH

SQLSTATE: 22000

<message>

If you don’t need to make any other changes to your code, then please set the SQL

configuration: ‘<sourceProtocolVersionKey> = <value>

to resume your stream. Please refer to:

<docLink>

for more details.

CF_REGION_NOT_FOUND_ERROR

SQLSTATE: 42000

Could not get default AWS Region. Please specify a region using the cloudFiles.region option.

CF_RESOURCE_SUFFIX_EMPTY

SQLSTATE: 42000

Failed to create notification services: the resource suffix cannot be empty.

CF_RESOURCE_SUFFIX_INVALID_CHAR_AWS

SQLSTATE: 42000

Failed to create notification services: the resource suffix can only have alphanumeric characters, hyphens (-) and underscores (_).

CF_RESOURCE_SUFFIX_INVALID_CHAR_AZURE

SQLSTATE: 42000

Failed to create notification services: the resource suffix can only have lowercase letter, number, and dash (-).

CF_RESOURCE_SUFFIX_INVALID_CHAR_GCP

SQLSTATE: 42000

Failed to create notification services: the resource suffix can only have alphanumeric characters, hyphens (-), underscores (_), periods (.), tildes (~) plus signs (+), and percent signs (<percentSign>).

CF_RESOURCE_SUFFIX_LIMIT

SQLSTATE: 42000

Failed to create notification services: the resource suffix cannot have more than <limit> characters.

CF_RESOURCE_SUFFIX_LIMIT_GCP

SQLSTATE: 42000

Failed to create notification services: the resource suffix must be between <lowerLimit> and <upperLimit> characters.

CF_RESTRICTED_GCP_RESOURCE_TAG_KEY

SQLSTATE: 22000

Found restricted GCP resource tag key (<key>). The following GCP resource tag keys are restricted for Auto Loader: [<restrictedKeys>]

CF_RETENTION_GREATER_THAN_MAX_FILE_AGE

SQLSTATE: 42000

cloudFiles.cleanSource.retentionDuration cannot be greater than cloudFiles.maxFileAge.

CF_SAME_PUB_SUB_TOPIC_NEW_KEY_PREFIX

SQLSTATE: 22000

Failed to create notification for topic: <topic> with prefix: <prefix>. There is already a topic with the same name with another prefix: <oldPrefix>. Try using a different resource suffix for setup or delete the existing setup.

CF_SOURCE_DIRECTORY_PATH_REQUIRED

SQLSTATE: 42000

Please provide the source directory path with option path

CF_SOURCE_UNSUPPORTED

SQLSTATE: 0A000

The cloud files source only supports S3, Azure Blob Storage (wasb/wasbs) and Azure Data Lake Gen1 (adl) and Gen2 (abfs/abfss) paths right now. path: ‘<path>’, resolved uri: ‘<uri>

CF_THREAD_IS_DEAD

SQLSTATE: 22000

<threadName> thread is dead.

CF_UNABLE_TO_DERIVE_STREAM_CHECKPOINT_LOCATION

SQLSTATE: 42000

Unable to derive the stream checkpoint location from the source checkpoint location: <checkPointLocation>

CF_UNABLE_TO_DETECT_FILE_FORMAT

SQLSTATE: 42000

Unable to detect the source file format from <fileSize> sampled file(s), found <formats>. Please specify the format.

CF_UNABLE_TO_EXTRACT_BUCKET_INFO

SQLSTATE: 42000

Unable to extract bucket information. Path: ‘<path>’, resolved uri: ‘<uri>’.

CF_UNABLE_TO_EXTRACT_KEY_INFO

SQLSTATE: 42000

Unable to extract key information. Path: ‘<path>’, resolved uri: ‘<uri>’.

CF_UNABLE_TO_EXTRACT_STORAGE_ACCOUNT_INFO

SQLSTATE: 42000

Unable to extract storage account information; path: ‘<path>’, resolved uri: ‘<uri>

CF_UNABLE_TO_LIST_EFFICIENTLY

SQLSTATE: 22000

Received a directory rename event for the path <path>, but we are unable to list this directory efficiently. In order for the stream to continue, set the option ‘cloudFiles.ignoreDirRenames’ to true, and consider enabling regular backfills with cloudFiles.backfillInterval for this data to be processed.

CF_UNABLE_TO_USE_INCREMENTAL_LISTING_WITH_COLON_IN_FILENAME

SQLSTATE: 22000

Unable to use incremental listing due to a colon in the file name <filePath>. To fix the issue, either rename all files with a colon or disable the incremental listing by setting cloudFiles.useIncrementalListing to false.

CF_UNEXPECTED_READ_LIMIT

SQLSTATE: 22000

Unexpected ReadLimit: <readLimit>

CF_UNKNOWN_OPTION_KEYS_ERROR

SQLSTATE: 42000

Found unknown option keys:

<optionList>

Please make sure that all provided option keys are correct. If you want to skip the

validation of your options and ignore these unknown options, you can set:

.option(“cloudFiles.<validateOptions>”, “false”)

CF_UNKNOWN_READ_LIMIT

SQLSTATE: 22000

Unknown ReadLimit: <readLimit>

CF_UNSUPPORTED_FORMAT_FOR_SCHEMA_INFERENCE

SQLSTATE: 0A000

Schema inference is not supported for format: <format>. Please specify the schema.

CF_UNSUPPORTED_LOG_VERSION

SQLSTATE: 0A000

UnsupportedLogVersion: maximum supported log version is v`<maxVersion>, but encountered v<version>`. The log file was produced by a newer version of DBR and cannot be read by this version. Please upgrade.

CF_UNSUPPORTED_SCHEMA_EVOLUTION_MODE

SQLSTATE: 0A000

Schema evolution mode <mode> is not supported for format: <format>. Please set the schema evolution mode to ‘none’.

CF_USE_DELTA_FORMAT

SQLSTATE: 42000

Reading from a Delta table is not supported with this syntax. If you would like to consume data from Delta, please refer to the docs: read a Delta table (<deltaDocLink>), or read a Delta table as a stream source (<streamDeltaDocLink>). The streaming source from Delta is already optimized for incremental consumption of data.

Geospatial

GEOJSON_PARSE_ERROR

SQLSTATE: 22023

Error parsing GeoJSON: <parseError> at position <pos>

For more details see GEOJSON_PARSE_ERROR

H3_INVALID_CELL_ID

SQLSTATE: 22023

<h3Cell> is not a valid H3 cell ID

For more details see H3_INVALID_CELL_ID

H3_INVALID_GRID_DISTANCE_VALUE

SQLSTATE: 22023

H3 grid distance <k> must be non-negative

For more details see H3_INVALID_GRID_DISTANCE_VALUE

H3_INVALID_RESOLUTION_VALUE

SQLSTATE: 22023

H3 resolution <r> must be between <minR> and <maxR>, inclusive

For more details see H3_INVALID_RESOLUTION_VALUE

H3_NOT_ENABLED

SQLSTATE: none assigned

<h3Expression> is disabled or unsupported. Consider enabling Photon or switch to a tier that supports H3 expressions

For more details see H3_NOT_ENABLED

H3_PENTAGON_ENCOUNTERED_ERROR

SQLSTATE: 22023

A pentagon was encountered while computing the hex ring of <h3Cell> with grid distance <k>

H3_UNDEFINED_GRID_DISTANCE

SQLSTATE: 22023

H3 grid distance between <h3Cell1> and <h3Cell2> is undefined

ST_INVALID_PRECISION_VALUE

SQLSTATE: 22023

Precision <p> must be between <minP> and <maxP>, inclusive

ST_INVALID_SRID_VALUE

SQLSTATE: 22023

Invalid or unsupported SRID <srid>

ST_NOT_ENABLED

SQLSTATE: none assigned

<stExpression> is disabled or unsupported. Consider enabling Photon or switch to a tier that supports ST expressions

WKB_PARSE_ERROR

SQLSTATE: 22023

Error parsing WKB: <parseError> at position <pos>

For more details see WKB_PARSE_ERROR

WKT_PARSE_ERROR

SQLSTATE: 22023

Error parsing WKT: <parseError> at position <pos>

For more details see WKT_PARSE_ERROR