Error conditions in Databricks

See https://spark.apache.org/docs/latest/sql-migration-guide.html#query-engine’.

ALTER TABLE <type> column <columnName> specifies descriptor “<optionName>” more than once, which is invalid.

AMBIGUOUS_ALIAS_IN_NESTED_CTE

SQLSTATE: none assigned

Name <name> is ambiguous in nested CTE.

Please set <config> to “CORRECTED” so that name defined in inner CTE takes precedence. If set it to “LEGACY”, outer CTE definitions will take precedence.

AMBIGUOUS_COLUMN_OR_FIELD

Column or field <name> is ambiguous and has <n> matches.

AMBIGUOUS_CONSTRAINT

SQLSTATE: 42K0C

Ambiguous reference to constraint <constraint>.

AMBIGUOUS_LATERAL_COLUMN_ALIAS

Lateral column alias <name> is ambiguous and has <n> matches.

AMBIGUOUS_REFERENCE

Reference <name> is ambiguous, could be: <referenceNames>.

AMBIGUOUS_REFERENCE_TO_FIELDS

Ambiguous reference to the field <field>. It appears <count> times in the schema.

ARGUMENT_NOT_CONSTANT

SQLSTATE: 42K08

The function <functionName> includes a parameter <parameterName> at position <pos> that requires a constant argument. Please compute the argument <sqlExpr> separately and pass the result as a constant.

ARITHMETIC_OVERFLOW

<message>.<alternative> If necessary set <config> to “false” to bypass this error.

For more details see ARITHMETIC_OVERFLOW

ASSIGNMENT_ARITY_MISMATCH

SQLSTATE: 42802

The number of columns or variables assigned or aliased: <numTarget> does not match the number of source expressions: <numExpr>.

AS_OF_JOIN

CANNOT_DROP_AMBIGUOUS_CONSTRAINT

SQLSTATE: 42K0C

Cannot drop the constraint with the name <constraintName> shared by a CHECK constraint

and a PRIMARY KEY or FOREIGN KEY constraint. You can drop the PRIMARY KEY or

FOREIGN KEY constraint by queries:

SQLSTATE: 58030

An error occurred during loading state.

For more details see CANNOT_LOAD_STATE_STORE

CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE

SQLSTATE: 42825

Failed to merge incompatible data types <left> and <right>. Please check the data types of the columns being merged and ensure that they are compatible. If necessary, consider casting the columns to compatible data types before attempting the merge.

CANNOT_MERGE_SCHEMAS

SQLSTATE: 42KD9

Failed merging schemas:

Initial schema:

<left>

Schema that cannot be merged with the initial schema:

<right>.

CANNOT_MODIFY_CONFIG

SQLSTATE: 46110

Cannot modify the value of the Spark config: <key>.

CANNOT_PARSE_DECIMAL

SQLSTATE: 22018

Cannot parse decimal. Please ensure that the input is a valid number with optional decimal point or comma separators.

CANNOT_PARSE_INTERVAL

SQLSTATE: none assigned

Unable to parse <intervalString>. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format. If the issue persists, please double check that the input value is not null or empty and try again.

CANNOT_PARSE_JSON_FIELD

SQLSTATE: 2203G

Cannot parse the field name <fieldName> and the value <fieldValue> of the JSON token type <jsonType> to target Spark data type <dataType>.

CANNOT_PARSE_PROTOBUF_DESCRIPTOR

SQLSTATE: none assigned

Error parsing descriptor bytes into Protobuf FileDescriptorSet.

CANNOT_PARSE_TIMESTAMP

SQLSTATE: 22007

<message>. If necessary set <ansiConfig> to “false” to bypass this error.

CANNOT_READ_ARCHIVED_FILE

Cannot read file at path <path> because it has been archived. Please adjust your query filters to exclude archived files.

CANNOT_READ_FILE

CANNOT_UPDATE_FIELD

SQLSTATE: none assigned

Cannot update <table> field <fieldName> type:

For more details see CANNOT_UPDATE_FIELD

CANNOT_UP_CAST_DATATYPE

SQLSTATE: none assigned

Cannot up cast <expression> from <sourceType> to <targetType>.

<details>

CANNOT_VALIDATE_CONNECTION

SQLSTATE: none assigned

Validation of <jdbcDialectName> connection is not supported. Please contact Databricks support for alternative solutions, or set “spark.databricks.testConnectionBeforeCreation” to “false” to skip connection testing before creating a connection object.

CAST_INVALID_INPUT

COLUMN_MASKS_DUPLICATE_USING_COLUMN_NAME

SQLSTATE: 42734

A <statementType> statement attempted to assign a column mask policy to a column which included two or more other referenced columns in the USING COLUMNS list with the same name <columnName>, which is invalid.

COLUMN_MASKS_FEATURE_NOT_SUPPORTED

CONCURRENT_QUERY

SQLSTATE: none assigned

Another instance of this query [id: <queryId>] was just started by a concurrent session [existing runId: <existingQueryRunId> new runId: <newQueryRunId>].

CONCURRENT_STREAM_LOG_UPDATE

SQLSTATE: 40000

Concurrent update to the log. Multiple streaming jobs detected for <batchId>.

Please make sure only one streaming job runs on a specific checkpoint location at a time.

CONNECT

SQLSTATE: none assigned

Generic Spark Connect error.

For more details see CONNECT

CONNECTION_ALREADY_EXISTS

CREATE_PERMANENT_VIEW_WITHOUT_ALIAS

SQLSTATE: none assigned

Not allowed to create the permanent view <name> without explicitly assigning an alias for the expression <attr>.

CREATE_TABLE_COLUMN_DESCRIPTOR_DUPLICATE

CREATE TABLE column <columnName> specifies descriptor “<optionName>” more than once, which is invalid.

CREATE_VIEW_COLUMN_ARITY_MISMATCH

SQLSTATE: 21S01

Cannot create view <viewName>, the reason is

For more details see CREATE_VIEW_COLUMN_ARITY_MISMATCH

CREDENTIAL_MISSING

Please provide credentials when creating or updating external locations.

CYCLIC_FUNCTION_REFERENCE

SQLSTATE: 42887

Cyclic function reference detected: <path>.

DATABRICKS_DELTA_NOT_ENABLED

Databricks Delta is not enabled in your account.<hints>

DATATYPE_MISMATCH

Cannot resolve <sqlExpr> due to data type mismatch:

For more details see DATATYPE_MISMATCH

DATATYPE_MISSING_SIZE

SQLSTATE: 42K01

DataType <type> requires a length parameter, for example <type>(10). Please specify the length.

DATA_SOURCE_NOT_FOUND

SQLSTATE: 42K02

Failed to find data source: <provider>. Please find packages at https://spark.apache.org/third-party-projects.html.

DATA_SOURCE_OPTION_CONTAINS_INVALID_CHARACTERS

Option <option> must not be empty and should not contain invalid characters, query strings, or parameters.

DATA_SOURCE_OPTION_IS_REQUIRED

Option <option> is required.

DATA_SOURCE_URL_NOT_ALLOWED

SQLSTATE: 42KDB

JDBC URL is not allowed in data source options, please specify ‘host’, ‘port’, and ‘database’ options instead.

DATETIME_OVERFLOW

SQLSTATE: 22008

Datetime operation overflow: <operation>.

DECIMAL_PRECISION_EXCEEDS_MAX_PRECISION

Decimal precision <precision> exceeds max precision <maxPrecision>.

DEFAULT_DATABASE_NOT_EXISTS

Default database <defaultDatabase> does not exist, please create it first or change default database to <defaultDatabase>.

DEFAULT_FILE_NOT_FOUND

It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running ‘REFRESH TABLE tableName’ command in SQL or by recreating the Dataset/DataFrame involved. If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.

DEFAULT_PLACEMENT_INVALID

SQLSTATE: 42608

A DEFAULT keyword in a MERGE, INSERT, UPDATE, or SET VARIABLE command could not be directly assigned to a target column because it was part of an expression.

For example: UPDATE SET c1 = DEFAULT is allowed, but UPDATE T SET c1 = DEFAULT + 1 is not allowed.

DIFFERENT_DELTA_TABLE_READ_BY_STREAMING_SOURCE

SQLSTATE: 55019

The streaming query was reading from an unexpected Delta table (id = ‘<newTableId>’).

It used to read from another Delta table (id = ‘<oldTableId>’) according to checkpoint.

This may happen when you changed the code to read from a new table or you deleted and

re-created a table. Please revert your change or delete your streaming query checkpoint

to restart from scratch.

DISTINCT_WINDOW_FUNCTION_UNSUPPORTED

SQLSTATE: none assigned

Distinct window functions are not supported: <windowExpr>.

DIVIDE_BY_ZERO

DUPLICATE_KEY

SQLSTATE: 23505

Found duplicate keys <keyColumn>.

DUPLICATE_ROUTINE_PARAMETER_ASSIGNMENT

Call to function <functionName> is invalid because it includes multiple argument assignments to the same parameter name <parameterName>.

For more details see DUPLICATE_ROUTINE_PARAMETER_ASSIGNMENT

DUPLICATE_ROUTINE_PARAMETER_NAMES

SQLSTATE: 42734

Found duplicate name(s) in the parameter list of the user-defined routine <routineName>: <names>.

DUPLICATE_ROUTINE_RETURNS_COLUMNS

SQLSTATE: 42711

Found duplicate column(s) in the RETURNS clause column list of the user-defined routine <routineName>: <columns>.

EMPTY_JSON_FIELD_VALUE

Failed to parse an empty string for data type <dataType>.

EMPTY_LOCAL_FILE_IN_STAGING_ACCESS_QUERY

Empty local file in staging <operation> query

ENCODER_NOT_FOUND

SQLSTATE: none assigned

Not found an encoder of the type <typeName> to Spark SQL internal representation. Consider to change the input type to one of supported at ‘<docroot>/sql-ref-datatypes.html’.

ERROR_READING_AVRO_UNKNOWN_FINGERPRINT

SQLSTATE: none assigned

Error reading avro data – encountered an unknown fingerprint: <fingerprint>, not sure what schema to use. This could happen if you registered additional schemas after starting your spark context.

EVENT_LOG_REQUIRES_SHARED_COMPUTE

Cannot query event logs from an Assigned or No Isolation Shared cluster, please use a Shared cluster or a Databricks SQL warehouse instead.

EVENT_LOG_UNAVAILABLE

SQLSTATE: 55019

No event logs available for <tableOrPipeline>. Please try again later after events are generated

EVENT_LOG_UNSUPPORTED_TABLE_TYPE

SQLSTATE: 42832

The table type of <tableIdentifier> is <tableType>.

Querying event logs only supports Materialized Views, Streaming Tables, or Delta Live Tables pipelines

EVENT_TIME_IS_NOT_ON_TIMESTAMP_TYPE

SQLSTATE: none assigned

The event time <eventName> has the invalid type <eventType>, but expected “TIMESTAMP”.

EXCEED_LIMIT_LENGTH

SQLSTATE: none assigned

Exceeds char/varchar type length limitation: <limit>.

EXCEPT_NESTED_COLUMN_INVALID_TYPE

SQLSTATE: 428H2

EXCEPT column <columnName> was resolved and expected to be StructType, but found type <dataType>.

EXCEPT_OVERLAPPING_COLUMNS

Columns in an EXCEPT list must be distinct and non-overlapping.

EXCEPT_RESOLVED_COLUMNS_WITHOUT_MATCH

EXCEPT columns [<exceptColumns>] were resolved, but do not match any of the columns [<expandedColumns>] from the star expansion.

EXCEPT_UNRESOLVED_COLUMN_IN_STRUCT_EXPANSION

The column/field name <objectName> in the EXCEPT clause cannot be resolved. Did you mean one of the following: [<objectList>]?

Note: nested columns in the EXCEPT clause may not include qualifiers (table name, parent struct column name, etc.) during a struct expansion; try removing qualifiers if they are used with nested columns.

EXPRESSION_TYPE_IS_NOT_ORDERABLE

SQLSTATE: none assigned

Column expression <expr> cannot be sorted because its type <exprType> is not orderable.

EXTERNAL_TABLE_INVALID_SCHEME

External tables don’t support the <scheme> scheme.

FAILED_EXECUTE_UDF

SQLSTATE: 39000

Failed to execute user defined function (<functionName>: (<signature>) => <result>).

FAILED_FUNCTION_CALL

SQLSTATE: 38000

Failed preparing of the function <funcName> for call. Please, double check function’s arguments.

FAILED_PARSE_STRUCT_TYPE

SQLSTATE: 22018

Failed parsing struct: <raw>.

FAILED_REGISTER_CLASS_WITH_KRYO

SQLSTATE: none assigned

Failed to register classes with Kryo.

FAILED_RENAME_PATH

SQLSTATE: 42K04

Failed to rename <sourcePath> to <targetPath> as destination already exists.

FAILED_RENAME_TEMP_FILE

SQLSTATE: none assigned

Failed to rename temp file <srcPath> to <dstPath> as FileSystem.rename returned false.

FEATURE_NOT_ON_CLASSIC_WAREHOUSE

<feature> is not supported on Classic SQL warehouses. To use this feature, use a Pro or Serverless SQL warehouse. To learn more about warehouse types, see <docLink>

FEATURE_REQUIRES_UC

SQLSTATE: 0AKUD

<feature> is not supported without Unity Catalog. To use this feature, enable Unity Catalog. To learn more about Unity Catalog, see <docLink>

FEATURE_UNAVAILABLE

<feature> is not supported in your environment. To use this feature, please contact Databricks Support.

FIELDS_ALREADY_EXISTS

SQLSTATE: none assigned

Cannot <op> column, because <fieldNames> already exists in <struct>.

FIELD_NOT_FOUND

No such struct field <fieldName> in <fields>.

FILE_IN_STAGING_PATH_ALREADY_EXISTS

SQLSTATE: 42K04

File in staging path <path> already exists but OVERWRITE is not set

FORBIDDEN_OPERATION

The operation <statement> is not allowed on the <objectType>: <objectName>.

FOREIGN_KEY_MISMATCH

SQLSTATE: 42830

Foreign key parent columns <parentColumns> do not match primary key child columns <childColumns>.

FOREIGN_OBJECT_NAME_CANNOT_BE_EMPTY

Cannot execute this command because the foreign <objectType> name must be non-empty.

FROM_JSON_CONFLICTING_SCHEMA_UPDATES

from_json inference encountered conflicting schema updates at: <location>

FROM_JSON_CORRUPT_SCHEMA

from_json inference could not read the schema stored at: <location>

FROM_JSON_INFERENCE_NOT_SUPPORTED

from_json inference is only supported when defining streaming tables

FROM_JSON_INVALID_CONFIGURATION

from_json configuration is invalid:

For more details see FROM_JSON_INVALID_CONFIGURATION

GENERATED_COLUMN_WITH_DEFAULT_VALUE

SQLSTATE: none assigned

A column cannot have both a default value and a generation expression but column <colName> has default value: (<defaultValue>) and generation expression: (<genExpr>).

GRAPHITE_SINK_INVALID_PROTOCOL

SQLSTATE: none assigned

Invalid Graphite protocol: <protocol>.

GRAPHITE_SINK_PROPERTY_MISSING

SQLSTATE: none assigned

Graphite sink requires ‘<property>’ property.

GROUPING_COLUMN_MISMATCH

Column of grouping (<grouping>) can’t be found in grouping columns <groupingColumns>.

GROUPING_ID_COLUMN_MISMATCH

Columns of grouping_id (<groupingIdColumn>) does not match grouping columns (<groupByColumns>).

GROUPING_SIZE_LIMIT_EXCEEDED

SQLSTATE: 54000

Grouping sets size cannot be greater than <maxSize>.

GROUP_BY_AGGREGATE

SQLSTATE: 42903

Aggregate functions are not allowed in GROUP BY, but found <sqlExpr>.

For more details see GROUP_BY_AGGREGATE

INCOMPATIBLE_DATA_FOR_TABLE

SQLSTATE: KD000

Cannot write incompatible data for the table <tableName>:

For more details see INCOMPATIBLE_DATA_FOR_TABLE

INCOMPATIBLE_JOIN_TYPES

The join types <joinType1> and <joinType2> are incompatible.

INCOMPATIBLE_VIEW_SCHEMA_CHANGE

SQLSTATE: none assigned

The SQL query of view <viewName> has an incompatible schema change and column <colName> cannot be resolved. Expected <expectedNum> columns named <colName> but got <actualCols>.

Please try to re-create the view by running: <suggestion>.

INCOMPLETE_TYPE_DEFINITION

SQLSTATE: 42K01

Incomplete complex type:

For more details see INCOMPLETE_TYPE_DEFINITION

INCONSISTENT_BEHAVIOR_CROSS_VERSION

SQLSTATE: 42K0B

You may get a different result due to the upgrading to

For more details see INCONSISTENT_BEHAVIOR_CROSS_VERSION

INCORRECT_END_OFFSET

Max offset with <rowsPerSecond> rowsPerSecond is <maxSeconds>, but it’s <endSeconds> now.

INCORRECT_NUMBER_OF_ARGUMENTS

SQLSTATE: 42605

<failure>, <functionName> requires at least <minArgs> arguments and at most <maxArgs> arguments.

INCORRECT_RAMP_UP_RATE

Max offset with <rowsPerSecond> rowsPerSecond is <maxSeconds>, but ‘rampUpTimeSeconds’ is <rampUpTimeSeconds>.

INDEX_ALREADY_EXISTS

Cannot create the index <indexName> on table <tableName> because it already exists.

INDEX_NOT_FOUND

Cannot find the index <indexName> on table <tableName>.

INSERT_COLUMN_ARITY_MISMATCH

SQLSTATE: 21S01

Cannot write to <tableName>, the reason is

For more details see INSERT_COLUMN_ARITY_MISMATCH

INSERT_PARTITION_COLUMN_ARITY_MISMATCH

SQLSTATE: 21S01

Cannot write to ‘<tableName>’, <reason>:

Table columns: <tableColumns>.

Partition columns with static values: <staticPartCols>.

Data columns: <dataColumns>.

INSUFFICIENT_PERMISSIONS

SQLSTATE: 42501

SQLSTATE: 42501

User cannot <action> on <securableName> because of permissions on underlying securables:

<underlyingReport>

INSUFFICIENT_TABLE_PROPERTY

SQLSTATE: none assigned

For more details see INVALID_ARRAY_INDEX

INVALID_ARRAY_INDEX_IN_ELEMENT_AT

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use try_element_at to tolerate accessing element at invalid index and return NULL instead. If necessary set <ansiConfig> to “false” to bypass this error.

For more details see INVALID_ARRAY_INDEX_IN_ELEMENT_AT

INVALID_BITMAP_POSITION

The 0-indexed bitmap position <bitPosition> is out of bounds. The bitmap has <bitmapNumBits> bits (<bitmapNumBytes> bytes).

INVALID_BOUNDARY

SQLSTATE: none assigned

The boundary <boundary> is invalid: <invalidValue>.

For more details see INVALID_BOUNDARY

INVALID_BUCKET_FILE

SQLSTATE: none assigned

Invalid bucket file: <path>.

INVALID_BYTE_STRING

SQLSTATE: none assigned

The expected format is ByteString, but was <unsupported> (<class>).

INVALID_COLUMN_NAME_AS_PATH

SQLSTATE: 46121

The datasource <datasource> cannot save the column <columnName> because its name contains some characters that are not allowed in file paths. Please, use an alias to rename it.

INVALID_COLUMN_OR_FIELD_DATA_TYPE

Column or field <name> is of type <type> while it’s required to be <expectedType>.

INVALID_CURSOR

SQLSTATE: HY109

The cursor is invalid.

For more details see INVALID_CURSOR

INVALID_DEFAULT_VALUE

For more details see INVALID_FORMAT

INVALID_FRACTION_OF_SECOND

The fraction of sec must be zero. Valid range is [0, 60]. If necessary set <ansiConfig> to “false” to bypass this error.

INVALID_HANDLE

SQLSTATE: HY000

The handle <handle> is invalid.

For more details see INVALID_HANDLE

INVALID_HIVE_COLUMN_NAME

SQLSTATE: none assigned

Cannot create the table <tableName> having the nested column <columnName> whose name contains invalid characters <invalidChars> in Hive metastore.

INVALID_IDENTIFIER

The identifier <ident> is invalid. Please, consider quoting it with back-quotes as <ident>.

INVALID_INDEX_OF_ZERO

The index 0 is invalid. An index shall be either < 0 or > 0 (the first element has index 1).

INVALID_INLINE_TABLE

SQLSTATE: none assigned

Invalid inline table.

For more details see INVALID_INLINE_TABLE

INVALID_JSON_ROOT_FIELD

SQLSTATE: 22032

Cannot convert JSON root field to target Spark type.

SQLSTATE: none assigned

Numeric literal <rawStrippedQualifier> is outside the valid range for <typeName> with minimum value of <minValue> and maximum value of <maxValue>. Please adjust the value accordingly.

INVALID_OBSERVED_METRICS

SQLSTATE: none assigned

Invalid observed metrics.

For more details see INVALID_OBSERVED_METRICS

INVALID_OPTIONS

SQLSTATE: 42K06

Invalid options:

For more details see INVALID_OPTIONS

INVALID_PANDAS_UDF_PLACEMENT

The group aggregate pandas UDF <functionList> cannot be invoked together with as other, non-pandas aggregate functions.

INVALID_PARAMETER_MARKER_VALUE

An invalid parameter mapping was provided:

For more details see INVALID_PARAMETER_MARKER_VALUE

INVALID_PARAMETER_VALUE

The value of parameter(s) <parameter> in <functionName> is invalid:

For more details see INVALID_PARAMETER_VALUE

INVALID_PARTITION_OPERATION

SQLSTATE: none assigned

The partition command is invalid.

For more details see INVALID_PARTITION_OPERATION

INVALID_PIPELINE_ID

Pipeline id <pipelineId> is not valid.

A pipeline id should be a UUID in the format of ‘xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx’

INVALID_PRIVILEGE

SQLSTATE: 42852

Privilege <privilege> is not valid for <securable>.

INVALID_PROPERTY_KEY

<key> is an invalid property key, please use quotes, e.g. SET <key>=<value>.

INVALID_PROPERTY_VALUE

<value> is an invalid property value, please use quotes, e.g. SET <key>=<value>

INVALID_S3_COPY_CREDENTIALS

SQLSTATE: 42501

COPY INTO credentials must include AWS_ACCESS_KEY, AWS_SECRET_KEY, and AWS_SESSION_TOKEN.

INVALID_SCHEMA

SQLSTATE: 42K07

The input schema <inputSchema> is not a valid schema string.

For more details see INVALID_SCHEMA

INVALID_SCHEME

Unity catalog does not support <name> as the default file scheme.

INVALID_SECRET_LOOKUP

SQLSTATE: 22531

Invalid secret lookup:

For more details see INVALID_SECRET_LOOKUP

INVALID_SET_SYNTAX

Expected format is ‘SET’, ‘SET key’, or ‘SET key=value’. If you want to include special characters in key, or include semicolon in value, please use backquotes, e.g., SET key=value.

INVALID_SHARED_ALIAS_NAME

The <sharedObjectType> alias name must be of the form “schema.name”.

INVALID_SOURCE_CATALOG

Source catalog must not be within Unity Catalog for the SYNC command. Found <catalog>.

INVALID_SQL_ARG

SQLSTATE: none assigned

The argument <name> of sql() is invalid. Consider to replace it by a SQL literal.

INVALID_SQL_FUNCTION_PLAN_STRUCTURE

SQLSTATE: XXKD0

Invalid SQL function plan structure

<plan>

INVALID_SQL_SYNTAX

Invalid SQL syntax:

For more details see INVALID_SQL_SYNTAX

INVALID_STAGING_PATH_IN_STAGING_ACCESS_QUERY

Invalid staging path in staging <operation> query: <path>

INVALID_SUBQUERY_EXPRESSION

SQLSTATE: 42823

Invalid subquery:

For more details see INVALID_SUBQUERY_EXPRESSION

INVALID_TEMP_OBJ_REFERENCE

SQLSTATE: none assigned

Cannot create the persistent object <objName> of the type <obj> because it references to the temporary object <tempObjName> of the type <tempObj>. Please make the temporary object <tempObjName> persistent, or make the persistent object <objName> temporary.

INVALID_TIMESTAMP_FORMAT

The provided timestamp <timestamp> doesn’t match the expected syntax <format>.

INVALID_TIME_TRAVEL_TIMESTAMP_EXPR

SQLSTATE: none assigned

The time travel timestamp expression <expr> is invalid.

For more details see INVALID_TIME_TRAVEL_TIMESTAMP_EXPR

INVALID_TYPED_LITERAL

The value of the typed literal <valueType> is invalid: <value>.

INVALID_UDF_IMPLEMENTATION

SQLSTATE: none assigned

Function <funcName> does not implement ScalarFunction or AggregateFunction.

INVALID_UPGRADE_SYNTAX

<command> <supportedOrNot> the source table is in Hive Metastore and the destination table is in Unity Catalog.

INVALID_URL

SQLSTATE: none assigned

The url is invalid: <url>. If necessary set <ansiConfig> to “false” to bypass this error.

INVALID_USAGE_OF_STAR_OR_REGEX

Invalid usage of <elem> in <prettyName>.

INVALID_UUID

Malformed records are detected in record parsing: <badRecord>.

Parse Mode: <failFastMode>. To process malformed records as null result, try setting the option ‘mode’ as ‘PERMISSIVE’.

For more details see MALFORMED_RECORD_IN_PARSING

MANAGED_TABLE_WITH_CRED

Create managed table with storage credential is not supported.

MATERIALIZED_VIEW_MESA_REFRESH_WITHOUT_PIPELINE_ID

SQLSTATE: 55019

Cannot <refreshType> the materialized view because it predates having a pipelineId. To enable <refreshType> please drop and recreate the materialized view.

MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED

The materialized view operation <operation> is not allowed:

For more details see MATERIALIZED_VIEW_OPERATION_NOT_ALLOWED

MATERIALIZED_VIEW_OUTPUT_WITHOUT_EXPLICIT_ALIAS

SQLSTATE: none assigned

Output expression <expression> in a materialized view must be explicitly aliased.

MAX_RECORDS_PER_FETCH_INVALID_FOR_KINESIS_SOURCE

maxRecordsPerFetch needs to be a positive integer less than or equal to <kinesisRecordLimit>

MERGE_CARDINALITY_VIOLATION

SQLSTATE: 23K01

The ON search condition of the MERGE statement matched a single row from the target table with multiple rows of the source table.

This could result in the target row being operated on more than once with an update or delete operation and is not allowed.

MISSING_AGGREGATION

The non-aggregating expression <expression> is based on columns which are not participating in the GROUP BY clause.

Add the columns or the expression to the GROUP BY, aggregate the expression, or use <expressionAnyValue> if you do not care which of the values within a group is returned.

For more details see MISSING_AGGREGATION

MISSING_ATTRIBUTES

SQLSTATE: none assigned

Resolved attribute(s) <missingAttributes> missing from <input> in operator <operator>.

For more details see MISSING_ATTRIBUTES

MISSING_CONNECTION_OPTION

Connections of type ‘<connectionType>’ must include the following option(s): <requiredOptions>.

MISSING_GROUP_BY

The query does not include a GROUP BY clause. Add GROUP BY or turn it into the window functions using OVER clauses.

MISSING_NAME_FOR_CHECK_CONSTRAINT

CHECK constraint must have a name.

MISSING_PARAMETER_FOR_KAFKA

SQLSTATE: none assigned

Parameter <parameterName> is required for Kafka, but is not specified in <functionName>.

MISSING_PARAMETER_FOR_ROUTINE

SQLSTATE: 42605

Parameter <parameterName> is required, but is not specified in <functionName>.

MODIFY_BUILTIN_CATALOG

SQLSTATE: 42832

Modifying built-in catalog <catalogName> is not supported.

MULTIPLE_LOAD_PATH

Databricks Delta does not support multiple input paths in the load() API.

paths: <pathList>. To build a single DataFrame by loading

multiple paths from the same Delta table, please load the root path of

the Delta table with the corresponding partition filters. If the multiple paths

Cannot create namespace <nameSpaceName> because it already exists.

Choose a different name, drop the existing namespace, or add the IF NOT EXISTS clause to tolerate pre-existing namespace.

NAMESPACE_NOT_EMPTY

Cannot drop a namespace <nameSpaceNameName> because it contains objects.

Use DROP NAMESPACE … CASCADE to drop the namespace and all its objects.

NAMESPACE_NOT_FOUND

PARSE_EMPTY_STATEMENT

SQLSTATE: 42617

Syntax error, unexpected empty statement.

PARSE_SYNTAX_ERROR

Syntax error at or near <error>``<hint>.

PARTITIONS_ALREADY_EXIST

SQLSTATE: 428FT

Cannot ADD or RENAME TO partition(s) <partitionList> in table <tableName> because they already exist.

Choose a different name, drop the existing partition, or add the IF NOT EXISTS clause to tolerate a pre-existing partition.

PARTITIONS_NOT_FOUND

Unable to access referenced table because a previously assigned column mask is currently incompatible with the table schema; to continue, please contact the owner of the table to update the policy:

For more details see QUERIED_TABLE_INCOMPATIBLE_WITH_COLUMN_MASK_POLICY

QUERIED_TABLE_INCOMPATIBLE_WITH_ROW_LEVEL_SECURITY_POLICY

REQUIRES_SINGLE_PART_NAMESPACE

<sessionCatalog> requires a single-part namespace, but got <namespace>.

RESERVED_CDC_COLUMNS_ON_WRITE

The write contains reserved columns <columnList> that are used

internally as metadata for Change Data Feed. To write to the table either rename/drop

these columns or disable Change Data Feed on the table by setting

<config> to false.

ROUTINE_ALREADY_EXISTS

SQLSTATE: 42723

Cannot create the function <routineName> because it already exists.

Choose a different name, drop or replace the existing function, or add the IF NOT EXISTS clause to tolerate a pre-existing function.

ROUTINE_NOT_FOUND

The function <routineName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP FUNCTION IF EXISTS.

ROUTINE_PARAMETER_NOT_FOUND

The function <functionName> does not support the parameter <parameterName> specified at position <pos>.<suggestion>

ROUTINE_USES_SYSTEM_RESERVED_CLASS_NAME

The function <routineName> cannot be created because the specified classname ‘<className>’ is reserved for system use. Please rename the class and try again.

ROW_LEVEL_SECURITY_CHECK_CONSTRAINT_UNSUPPORTED

Creating CHECK constraint on table <tableName> with row level security policies is not supported.

ROW_LEVEL_SECURITY_DUPLICATE_COLUMN_NAME

SQLSTATE: 42734

A <statementType> statement attempted to assign a row level security policy to a table, but two or more referenced columns had the same name <columnName>, which is invalid.

ROW_LEVEL_SECURITY_FEATURE_NOT_SUPPORTED

Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema.

SCHEMA_NOT_EMPTY

SQLSTATE: 2BP01

Cannot drop a schema <schemaName> because it contains objects.

Use DROP SCHEMA … CASCADE to drop the schema and all its objects.

SCHEMA_NOT_FOUND

The schema <schemaName> cannot be found. Verify the spelling and correctness of the schema and catalog.

The operation <operation> is not allowed:

For more details see STREAMING_TABLE_OPERATION_NOT_ALLOWED

STREAMING_TABLE_QUERY_INVALID

Streaming table <tableName> can only be created from a streaming query. Please add the STREAM keyword to your FROM clause to turn this relation into a streaming query.

STREAM_FAILED

SQLSTATE: none assigned

Query [id = <id>, runId = <runId>] terminated with exception: <message>

STREAM_NOT_FOUND_FOR_KINESIS_SOURCE

SQLSTATE: 42K02

Kinesis stream <streamName> in <region> not found.

Please start a new query pointing to the correct stream name.

SUM_OF_LIMIT_AND_OFFSET_EXCEEDS_MAX_INT

SQLSTATE: none assigned

The sum of the LIMIT clause and the OFFSET clause must not be greater than the maximum 32-bit integer value (2,147,483,647) but found limit = <limit>, offset = <offset>.

SYNC_METADATA_DELTA_ONLY

Repair table sync metadata command is only supported for delta table.

SYNC_METADATA_NOT_SUPPORTED

SQLSTATE: 0AKUD

Repair table sync metadata command is only supported for Unity Catalog tables.

SYNC_SRC_TARGET_TBL_NOT_SAME

SQLSTATE: 42KD2

Source table name <srcTable> must be same as destination table name <destTable>.

TABLE_OR_VIEW_ALREADY_EXISTS

Cannot create table or view <relationName> because it already exists.

Choose a different name, drop or replace the existing object, add the IF NOT EXISTS clause to tolerate pre-existing objects, or add the OR REFRESH clause to refresh the existing streaming table.

TABLE_OR_VIEW_NOT_FOUND

The table or view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.

Cannot create the temporary view <relationName> because it already exists.

Choose a different name, drop or replace the existing view, or add the IF NOT EXISTS clause to tolerate pre-existing views.

TEMP_VIEW_NAME_TOO_MANY_NAME_PARTS

SQLSTATE: 428EK

CREATE TEMPORARY VIEW or the corresponding Dataset APIs only accept single-part view names, but got: <actualName>.

TOO_MANY_ARRAY_ELEMENTS

SQLSTATE: 54000

Cannot initialize array with <numElements> elements of size <size>.

UC_BUCKETED_TABLES

Bucketed tables are not supported in Unity Catalog.

UC_CATALOG_NAME_NOT_PROVIDED

SQLSTATE: 3D000

For Unity Catalog, please specify the catalog name explicitly. E.g. SHOW GRANT your.address@email.com ON CATALOG main.

UC_COMMAND_NOT_SUPPORTED

The command(s): <commandName> are not supported in Unity Catalog.

For more details see UC_COMMAND_NOT_SUPPORTED

UC_DATASOURCE_NOT_SUPPORTED

Data source format <dataSourceFormatName> is not supported in Unity Catalog.

UC_DATASOURCE_OPTIONS_NOT_SUPPORTED

Data source options are not supported in Unity Catalog.

UC_EXTERNAL_VOLUME_MISSING_LOCATION

SQLSTATE: none assigned

LOCATION clause must be present for external volume. Please check the syntax ‘CREATE EXTERNAL VOLUME … LOCATION …’ for creating an external volume.

UC_FILE_SCHEME_FOR_TABLE_CREATION_NOT_SUPPORTED

UDF_UNSUPPORTED_PARAMETER_DEFAULT_VALUE

Parameter default value is not supported for user-defined <functionType> function.

UDF_USER_CODE_ERROR

SQLSTATE: 39000

Execution of function <fn> failed.

For more details see UDF_USER_CODE_ERROR

UDTF_ALIAS_NUMBER_MISMATCH

SQLSTATE: none assigned

The number of aliases supplied in the AS clause does not match the number of columns output by the UDTF. Expected <aliasesSize> aliases, but got <aliasesNames>. Please ensure that the number of aliases provided matches the number of columns output by the UDTF.

UNABLE_TO_ACQUIRE_MEMORY

SQLSTATE: 53200

Unable to acquire <requestedBytes> bytes of memory, got <receivedBytes>.

UNABLE_TO_CONVERT_TO_PROTOBUF_MESSAGE_TYPE

SQLSTATE: none assigned

Unable to convert SQL type <toType> to Protobuf type <protobufType>.

UNABLE_TO_INFER_SCHEMA

SQLSTATE: 42KD9

Unable to infer schema for <format>. It must be specified manually.

UNBOUND_SQL_PARAMETER

SQLSTATE: 42P02

Found the unbound parameter: <name>. Please, fix args and provide a mapping of the parameter to a SQL literal.

UNCLOSED_BRACKETED_COMMENT

Found an unclosed bracketed comment. Please, append */ at the end of the comment.

UNEXPECTED_INPUT_TYPE

Parameter <paramIndex> of function <functionName> requires the <requiredType> type, however <inputSql> has the type <inputType>.

UNEXPECTED_OPERATOR_IN_STREAMING_VIEW

SQLSTATE: 42KDD

Unexpected operator <op> in the CREATE VIEW statement as a streaming source.

A streaming view query must consist only of SELECT, WHERE, and UNION ALL operations.

UNEXPECTED_POSITIONAL_ARGUMENT

Cannot invoke function <functionName> because it contains positional argument(s) following the named argument assigned to <parameterName>; please rearrange them so the positional arguments come first and then retry the query again.

UNITY_CREDENTIAL_SCOPE_MISSING_SCOPE

SQLSTATE: none assigned

Missing Credential Scope. <details>.

UNKNOWN_FIELD_EXCEPTION

Encountered unknown fields during parsing: <unknownFieldBlob>, which can be fixed by an automatic retry: <isRetryable>

For more details see UNKNOWN_FIELD_EXCEPTION

UNKNOWN_POSITIONAL_ARGUMENT

The invocation of function <functionName> contains an unknown positional argument <sqlExpr> at position <pos>. This is invalid.

UNKNOWN_PROTOBUF_MESSAGE_TYPE

SQLSTATE: none assigned

Attempting to treat <descriptorName> as a Message, but it was <containingType>.

UNKNOWN_TABLE_TYPE

SQLSTATE: XXKUC

Unsupported table table <type>.

UNPIVOT_REQUIRES_ATTRIBUTES

SQLSTATE: 42K0A

UNPIVOT requires all given <given> expressions to be columns when no <empty> expressions are given. These are not columns: [<expressions>].

UNPIVOT_REQUIRES_VALUE_COLUMNS

SQLSTATE: 42K0A

At least one value column needs to be specified for UNPIVOT, all columns specified as ids.

UNPIVOT_VALUE_DATA_TYPE_MISMATCH

Unpivot value columns must share a least common type, some types do not: [<types>].

UNPIVOT_VALUE_SIZE_MISMATCH

SQLSTATE: 428C4

All unpivot value columns must have the same size as there are value column names (<names>).

UNRECOGNIZED_PARAMETER_NAME

Cannot invoke function <functionName> because the function call included a named argument reference for the argument named <argumentName>, but this function does not include any signature containing an argument with this name. Did you mean one of the following? [<proposal>].

UNRECOGNIZED_SQL_TYPE

Unrecognized SQL type - name: <typeName>, id: <jdbcType>.

UNRESOLVABLE_TABLE_VALUED_FUNCTION

SQLSTATE: none assigned

Could not resolve <name> to a table-valued function. Please make sure that <name> is defined as a table-valued function and that all required parameters are provided correctly. If <name> is not defined, please create the table-valued function before using it. For more information about defining table-valued functions, please refer to the Apache Spark documentation.

UNRESOLVED_ALL_IN_GROUP_BY

Cannot infer grouping columns for GROUP BY ALL based on the select clause. Please explicitly specify the grouping columns.

UNRESOLVED_COLUMN

A column, variable, or function parameter with name <objectName> cannot be resolved.

For more details see UNRESOLVED_COLUMN

UNRESOLVED_FIELD

A field with name <fieldName> cannot be resolved with the struct-type column <columnPath>.

For more details see UNRESOLVED_FIELD

UNRESOLVED_MAP_KEY

Cannot resolve column <objectName> as a map key. If the key is a string literal, add the single quotes ‘’ around it.

For more details see UNRESOLVED_MAP_KEY

UNRESOLVED_ROUTINE

Cannot resolve function <routineName> on search path <searchPath>.

For more details see UNRESOLVED_ROUTINE

UNRESOLVED_USING_COLUMN_FOR_JOIN

USING column <colName> cannot be resolved on the <side> side of the join. The <side>-side columns: [<suggestion>].

UNRESOLVED_VARIABLE

Cannot resolve variable <variableName> on search path <searchPath>.

UNSET_NONEXISTENT_PROPERTIES

SQLSTATE: none assigned

Attempted to unset non-existent properties [<properties>] in table <table>.

UNSUPPORTED_ADD_FILE

SQLSTATE: none assigned

Don’t support add file.

For more details see UNSUPPORTED_ADD_FILE

UNSUPPORTED_ARROWTYPE

Unsupported arrow type <typeName>.

UNSUPPORTED_BATCH_TABLE_VALUED_FUNCTION

The function <funcName> does not support batch queries.

UNSUPPORTED_CHAR_OR_VARCHAR_AS_STRING

SQLSTATE: none assigned

The char/varchar type can’t be used in the table schema. If you want Spark treat them as string type as same as Spark 3.0 and earlier, please set “spark.sql.legacy.charVarcharAsString” to “true”.

UNSUPPORTED_COMMON_ANCESTOR_LOC_FOR_FILE_STREAM_SOURCE

SQLSTATE: 42616

The common ancestor of source path and sourceArchiveDir should be registered with UC.

If you see this error message, it’s likely that you register the source path and sourceArchiveDir in different external locations.

Please put them into a single external location.

UNSUPPORTED_CONSTRAINT_CLAUSES

Constraint clauses <clauses> are unsupported.

UNSUPPORTED_CONSTRAINT_TYPE

Unsupported constraint type. Only <supportedConstraintTypes> are supported

UNSUPPORTED_DATATYPE

Unsupported data type <typeName>.

UNSUPPORTED_DATA_SOURCE_FOR_DIRECT_QUERY

SQLSTATE: none assigned

The direct query on files does not support the data source type: <className>. Please try a different data source type or consider using a different query method.

UNSUPPORTED_DATA_TYPE_FOR_DATASOURCE

SQLSTATE: none assigned

The <format> datasource doesn’t support the column <columnName> of the type <columnType>.

UNSUPPORTED_DEFAULT_VALUE

SQLSTATE: none assigned

Can’t overwrite the target that is also being read from.

For more details see UNSUPPORTED_OVERWRITE

UNSUPPORTED_SAVE_MODE

SQLSTATE: none assigned

UPGRADE_NOT_SUPPORTED

Table is not eligible for upgrade from Hive Metastore to Unity Catalog. Reason:

For more details see UPGRADE_NOT_SUPPORTED

USER_DEFINED_FUNCTIONS

User defined function is invalid:

For more details see USER_DEFINED_FUNCTIONS

VARIABLE_ALREADY_EXISTS

SQLSTATE: 42723

Cannot create the variable <variableName> because it already exists.

Choose a different name, or drop or replace the existing variable.

VARIABLE_NOT_FOUND

The variable <variableName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VARIABLE IF EXISTS.

VIEW_ALREADY_EXISTS

Cannot create view <relationName> because it already exists.

Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.

VIEW_NOT_FOUND

The view <relationName> cannot be found. Verify the spelling and correctness of the schema and catalog.

If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.

To tolerate the error on drop use DROP VIEW IF EXISTS.

VOLUME_ALREADY_EXISTS

SQLSTATE: 42605

The <functionName> requires <expectedNum> parameters but the actual number is <actualNum>.

For more details see WRONG_NUM_ARGS

ZORDERBY_COLUMN_DOES_NOT_EXIST

SQLSTATE: 429BQ

Cannot change data type of <column> from <from> to <to>. This change contains column removals and additions, therefore they are ambiguous. Please make these changes individually using ALTER TABLE [ADD | DROP | RENAME] COLUMN.

DELTA_AMBIGUOUS_PARTITION_COLUMN

Ambiguous partition column <column> can be <colMatches>.

DELTA_AMBIGUOUS_PATHS_IN_CREATE_TABLE

CREATE TABLE contains two different locations: <identifier> and <location>.

You can remove the LOCATION clause from the CREATE TABLE statement, or set

<config> to true to skip this check.

DELTA_ARCHIVED_FILES_IN_LIMIT

SQLSTATE: 42KDC

Table <table> does not contain enough records in non-archived files to satisfy specified LIMIT of <limit> records.

DELTA_ARCHIVED_FILES_IN_SCAN

SQLSTATE: 42KDC

Found <numArchivedFiles> potentially archived file(s) in table <table> that need to be scanned as part of this query.

Archived files cannot be accessed. The current time until archival is configured as <archivalTime>.

Please adjust your query filters to exclude any archived files.

DELTA_BLOCK_COLUMN_MAPPING_AND_CDC_OPERATION

SQLSTATE: 42KD4

Operation “<opName>” is not allowed when the table has enabled change data feed (CDF) and has undergone schema changes using DROP COLUMN or RENAME COLUMN.

DELTA_BLOOM_FILTER_DROP_ON_NON_EXISTING_COLUMNS

Cannot drop bloom filter indices for the following non-existent column(s): <unknownColumns>

DELTA_BLOOM_FILTER_OOM_ON_WRITE

SQLSTATE: 82100)

OutOfMemoryError occurred while writing bloom filter indices for the following column(s): <columnsWithBloomFilterIndices>.

You can reduce the memory footprint of bloom filter indices by choosing a smaller value for the ‘numItems’ option, a larger value for the ‘fpp’ option, or by indexing fewer columns.

DELTA_CANNOT_CHANGE_DATA_TYPE

SQLSTATE: 429BQ

Cannot change data type: <dataType>

DELTA_CANNOT_CHANGE_LOCATION

Cannot change the ‘location’ of the Delta table using SET TBLPROPERTIES. Please use ALTER TABLE SET LOCATION instead.

DELTA_CANNOT_CHANGE_PROVIDER

‘provider’ is a reserved table property, and cannot be altered.

DELTA_CANNOT_CONVERT_TO_FILEFORMAT

Can not convert`<className>` to FileFormat.

DELTA_CANNOT_CREATE_BLOOM_FILTER_NON_EXISTING_COL

Cannot create bloom filter indices for the following non-existent column(s): <unknownCols>

DELTA_CANNOT_CREATE_LOG_PATH

SQLSTATE: 42KD5

Cannot create <path>

DELTA_CANNOT_DESCRIBE_VIEW_HISTORY

Cannot describe the history of a view.

DELTA_CANNOT_DROP_BLOOM_FILTER_ON_NON_INDEXED_COLUMN

Cannot drop bloom filter index on a non indexed column: <columnName>

DELTA_CANNOT_EVALUATE_EXPRESSION

Cannot evaluate expression: <expression>

DELTA_CANNOT_FIND_BUCKET_SPEC

Expecting a bucketing Delta table but cannot find the bucket spec in the table

DELTA_CANNOT_FIND_VERSION

Cannot find ‘sourceVersion’ in <json>

DELTA_CANNOT_GENERATE_CODE_FOR_EXPRESSION

Cannot generate code for expression: <expression>

DELTA_CANNOT_GENERATE_UPDATE_EXPRESSIONS

Calling without generated columns should always return a update expression for each column

DELTA_CANNOT_MODIFY_APPEND_ONLY

This table is configured to only allow appends. If you would like to permit updates or deletes, use ‘ALTER TABLE <table_name> SET TBLPROPERTIES (<config>=false)’.

DELTA_CANNOT_MODIFY_TABLE_PROPERTY

The Delta table configuration <prop> cannot be specified by the user

DELTA_CANNOT_RECONSTRUCT_PATH_FROM_URI

SQLSTATE: 22KD1

A uri (<uri>) which can’t be turned into a relative path was found in the transaction log.

DELTA_CANNOT_RELATIVIZE_PATH

Failed to write a value of <sourceType> type into the <targetType> type column <columnName> due to an overflow.

Use try_cast on the input value to tolerate overflow and return NULL instead.

File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This request appears to be targeting Change Data Feed, if that is the case, this error can occur when the change data file is out of the retention period and has been deleted by the VACUUM statement. For more information, see <faqPath>

DELTA_CHANGE_TABLE_FEED_DISABLED

SQLSTATE: 42807

Cannot write to table with delta.enableChangeDataFeed set. Change data feed from Delta is not available.

DELTA_CHECKPOINT_NON_EXIST_TABLE

Cannot checkpoint a non-existing table <path>. Did you manually delete files in the deltalog directory?

DELTA_CHECKPOINT_SNAPSHOT_MISMATCH

State of the checkpoint doesn’t match that of the snapshot.

DELTA_CLONE_AMBIGUOUS_TARGET

Two paths were provided as the CLONE target so it is ambiguous which to use. An external

location for CLONE was provided at <externalLocation> at the same time as the path

<targetIdentifier>.

DELTA_CLONE_INCOMPLETE_FILE_COPY

File (<fileName>) not copied completely. Expected file size: <expectedSize>, found: <actualSize>. To continue with the operation by ignoring the file size check set <config> to false.

DELTA_CLONE_UNSUPPORTED_SOURCE

Unsupported <mode> clone source ‘<name>’, whose format is <format>.

The supported formats are ‘delta’, ‘iceberg’ and ‘parquet’.

DELTA_CLUSTERING_CLONE_TABLE_NOT_SUPPORTED

CLONE is not supported for Delta table with Liquid clustering for DBR version < 14.0.

DELTA_CLUSTERING_COLUMN_MISSING_STATS

<tableSchema>

DELTA_COLUMN_PATH_NOT_NESTED

Expected <columnPath> to be a nested data type, but found <other>. Was looking for the

index of <column> in a nested field

DELTA_COLUMN_STRUCT_TYPE_MISMATCH

SQLSTATE: 2200G

Struct column <source> cannot be inserted into a <targetType> field <targetField> in <targetTable>.

DELTA_COMPACTION_VALIDATION_FAILED

The validation of the compaction of path <compactedPath> to <newPath> failed: Please file a bug report.

DELTA_COMPLEX_TYPE_COLUMN_CONTAINS_NULL_TYPE

SQLSTATE: 22005

Found nested NullType in column <columName> which is of <dataType>. Delta doesn’t support writing NullType in complex types.

DELTA_CONFLICT_SET_COLUMN

There is a conflict from these SET columns: <columnList>.

DELTA_CONSTRAINT_ALREADY_EXISTS

Constraint ‘<constraintName>’ already exists. Please delete the old constraint first.

Old constraint:

<oldConstraint>

DELTA_CONSTRAINT_DOES_NOT_EXIST

Cannot drop nonexistent constraint <constraintName> from table <tableName>. To avoid throwing an error, provide the parameter IF EXISTS or set the SQL session configuration <config> to <confValue>.

DELTA_CONVERSION_NO_PARTITION_FOUND

SQLSTATE: 42KD6

Found no partition information in the catalog for table <tableName>. Have you run “MSCK REPAIR TABLE” on your table to discover partitions?

DELTA_CONVERSION_UNSUPPORTED_COLUMN_MAPPING

The configuration ‘<config>’ cannot be set to <mode> when using CONVERT TO DELTA.

DELTA_CONVERT_NON_PARQUET_TABLE

CONVERT TO DELTA only supports parquet tables, but you are trying to convert a <sourceName> source: <tableId>

DELTA_CONVERT_TO_DELTA_ROW_TRACKING_WITHOUT_STATS

Cannot enable row tracking without collecting statistics.

If you want to enable row tracking, do the following:

Enable statistics collection by running the command

SET <statisticsCollectionPropertyKey> = true
1. Run CONVERT TO DELTA without the NO STATISTICS option.

If you do not want to collect statistics, disable row tracking:

Deactivate enabling the table feature by default by running the command:

RESET <rowTrackingTableFeatureDefaultKey>
1. Deactivate the table property by default by running:
  
  SET <rowTrackingDefaultPropertyKey> = false

DELTA_COPY_INTO_TARGET_FORMAT

COPY INTO target must be a Delta table.

DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_SCHEMA

You are trying to create an external table <tableName>

from <path> using Delta, but the schema is not specified when the

input path is empty.

To learn more about Delta, see <docLink>

DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_TXN_LOG

You are trying to create an external table <tableName>

from %2$s using Delta, but there is no transaction log present at

%2$s/_delta_log. Check the upstream job to make sure that it is writing using

format(“delta”) and that the path is the root of the table.

To learn more about Delta, see <docLink>

DELTA_CREATE_TABLE_SCHEME_MISMATCH

The specified schema does not match the existing schema at <path>.

== Specified ==

<specifiedSchema>

== Existing ==

<existingSchema>

== Differences ==

<schemaDifferences>

If your intention is to keep the existing schema, you can omit the

schema from the create table command. Otherwise please ensure that

the schema matches.

DELTA_CREATE_TABLE_SET_CLUSTERING_TABLE_FEATURE_NOT_ALLOWED

Cannot enable Liquid table feature using TBLPROPERTIES. Please use CREATE OR REPLACE TABLE CLUSTER BY to create a Delta table with Liquid clustering.

DELTA_CREATE_TABLE_WITH_DIFFERENT_PARTITIONING

The specified partitioning does not match the existing partitioning at <path>.

== Specified ==

<specifiedColumns>

== Existing ==

<existingColumns>

DELTA_CREATE_TABLE_WITH_DIFFERENT_PROPERTY

SQLSTATE: 42KD8

Index <columnIndex> to drop column is lower than 0

DELTA_DUPLICATE_ACTIONS_FOUND

SQLSTATE: 2D521

File operation ‘<actionType>’ for path <path> was specified several times.

It conflicts with <conflictingPath>.

It is not valid for multiple file operations with the same path to exist in a single commit.

DELTA_DUPLICATE_COLUMNS_FOUND

SQLSTATE: 42711

Found duplicate column(s) <coltype>: <duplicateCols>

DELTA_DUPLICATE_COLUMNS_ON_INSERT

Duplicate column names in INSERT clause

DELTA_DUPLICATE_COLUMNS_ON_UPDATE_TABLE

<message>

Please remove duplicate columns before you update your table.

DELTA_DUPLICATE_DATA_SKIPPING_COLUMNS

Duplicated data skipping columns found: <columns>.

DELTA_DUPLICATE_DOMAIN_METADATA_INTERNAL_ERROR

Internal error: two DomainMetadata actions within the same transaction have the same domain <domainName>

DELTA_DV_HISTOGRAM_DESERIALIZATON

Could not deserialize the deleted record counts histogram during table integrity verification.

DELTA_DYNAMIC_PARTITION_OVERWRITE_DISABLED

Dynamic partition overwrite mode is specified by session config or write options, but it is disabled by spark.databricks.delta.dynamicPartitionOverwrite.enabled=false.

DELTA_EMPTY_DATA

SQLSTATE: 428GU

Data used in creating the Delta table doesn’t have any columns.

DELTA_EMPTY_DIRECTORY

No file found in the directory: <directory>.

DELTA_EXCEED_CHAR_VARCHAR_LIMIT

SQLSTATE: 22001

Exceeds char/varchar type length limitation. Failed check: <expr>.

DELTA_EXPRESSIONS_NOT_FOUND_IN_GENERATED_COLUMN

Cannot find the expressions in the generated column <columnName>

DELTA_EXTRACT_REFERENCES_FIELD_NOT_FOUND

Field <fieldName> could not be found when extracting references.

DELTA_FAILED_CAST_PARTITION_VALUE

SQLSTATE: 22018

Failed to cast partition value <value> to <dataType>

DELTA_FAILED_FIND_ATTRIBUTE_IN_OUTPUT_COLUMNS

Could not find <newAttributeName> among the existing target output <targetOutputColumns>

DELTA_FAILED_FIND_PARTITION_COLUMN_IN_OUTPUT_PLAN

Could not find <partitionColumn> in output plan.

DELTA_FAILED_INFER_SCHEMA

SQLSTATE: 42KD9

Failed to infer schema from the given list of files.

DELTA_FAILED_MERGE_SCHEMA_FILE

SQLSTATE: 42KDA

Failed to merge schema of file <file>:

<schema>

DELTA_FAILED_READ_FILE_FOOTER

SQLSTATE: KD001

Could not read footer for file: <currentFile>

DELTA_FAILED_RECOGNIZE_PREDICATE

Cannot recognize the predicate ‘<predicate>’

DELTA_FAILED_SCAN_WITH_HISTORICAL_VERSION

Expect a full scan of the latest version of the Delta source, but found a historical scan of version <historicalVersion>

DELTA_FAILED_TO_MERGE_FIELDS

SQLSTATE: 22005

Failed to merge fields ‘<field>’ and ‘<fieldRoot>’. <fieldChild>

DELTA_FAIL_RELATIVIZE_PATH

Failed to relativize the path (<path>). This can happen when absolute paths make

it into the transaction log, which start with the scheme

s3://, wasbs:// or adls://. This is a bug that has existed before DBR 5.0.

To fix this issue, please upgrade your writer jobs to DBR 5.0 and please run:

%%scala com.databricks.delta.Delta.fixAbsolutePathsInLog(“<path>”).

If this table was created with a shallow clone across file systems

(different buckets/containers) and this table is NOT USED IN PRODUCTION, you can

set the SQL configuration <config>

to true. Using this SQL configuration could lead to accidental data loss,

therefore we do not recommend the use of this flag unless

this is a shallow clone for testing purposes.

DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: <features>.

DELTA_FEATURES_REQUIRE_MANUAL_ENABLEMENT

Your table schema requires manually enablement of the following table feature(s): <unsupportedFeatures>.

To do this, run the following command for each of features listed above:

ALTER TABLE table_name SET TBLPROPERTIES (‘delta.feature.feature_name’ = ‘supported’)

Replace “table_name” and “feature_name” with real values.

Current supported feature(s): <supportedFeatures>.

DELTA_FEATURE_DROP_CONFLICT_REVALIDATION_FAIL

Cannot drop feature because a concurrent transaction modified the table.

Please try the operation again.

<concurrentCommit>

DELTA_FEATURE_DROP_FEATURE_NOT_PRESENT

Cannot drop <feature> from this table because it is not currently present in the table’s protocol.

DELTA_FEATURE_DROP_HISTORICAL_VERSIONS_EXIST

Cannot drop <feature> because the Delta log contains historical versions that use the feature.

Please wait until the history retention period (<logRetentionPeriodKey>=<logRetentionPeriod>)

has passed since the feature was last active.

Dropping <feature> was partially successful.

The feature is now no longer used in the current version of the table. However, the feature

File (<path>) to be rewritten not found among candidate files:

<pathList>

DELTA_FOUND_MAP_TYPE_COLUMN

A MapType was found. In order to access the key or value of a MapType, specify one

of:

<key> or

<value>

followed by the name of the column (only if that column is a struct type).

e.g. mymap.key.mykey

If the column is a basic type, mymap.key or mymap.value is sufficient.

DELTA_GENERATED_COLUMNS_DATA_TYPE_MISMATCH

Column <columnName> is a generated column or a column used by a generated column. The data type is <columnType>. It doesn’t accept data type <dataType>

DELTA_GENERATED_COLUMNS_EXPR_TYPE_MISMATCH

The expression type of the generated column <columnName> is <expressionType>, but the column type is <columnType>

DELTA_GENERATED_COLUMN_UPDATE_TYPE_MISMATCH

Column <currentName> is a generated column or a column used by a generated column. The data type is <currentDataType> and cannot be converted to data type <updateDataType>

DELTA_ICEBERG_COMPAT_V1_VIOLATION

SQLSTATE: KD00E

The validation of IcebergCompatV1 has failed.

For more details see DELTA_ICEBERG_COMPAT_V1_VIOLATION

DELTA_ILLEGAL_FILE_FOUND

Illegal files found in a dataChange = false transaction. Files: <file>

DELTA_ILLEGAL_OPTION

SQLSTATE: 42616

Invalid value ‘<input>’ for option ‘<name>’, <explain>

DELTA_ILLEGAL_USAGE

The usage of <option> is not allowed when <operation> a Delta table.

DELTA_INCONSISTENT_BUCKET_SPEC

BucketSpec on Delta bucketed table does not match BucketSpec from metadata.Expected: <expected>. Actual: <actual>.

DELTA_INCONSISTENT_LOGSTORE_CONFS

SQLSTATE: F0000

(<setKeys>) cannot be set to different values. Please only set one of them, or set them to the same value.

DELTA_INCORRECT_ARRAY_ACCESS

Incorrectly accessing an ArrayType. Use arrayname.element.elementname position to

add to an array.

DELTA_INCORRECT_ARRAY_ACCESS_BY_NAME

An ArrayType was found. In order to access elements of an ArrayType, specify

<rightName>

Instead of <wrongName>

DELTA_INCORRECT_GET_CONF

Use getConf() instead of `conf.getConf()

DELTA_INCORRECT_LOG_STORE_IMPLEMENTATION

The error typically occurs when the default LogStore implementation, that

is, HDFSLogStore, is used to write into a Delta table on a non-HDFS storage system.

In order to get the transactional ACID guarantees on table updates, you have to use the

correct implementation of LogStore that is appropriate for your storage system.

See <docLink> for details.

DELTA_INDEX_LARGER_OR_EQUAL_THAN_STRUCT

SQLSTATE: 42KD8

Index <position> to drop column equals to or is larger than struct length: <length>

DELTA_INDEX_LARGER_THAN_STRUCT

SQLSTATE: 42KD8

Index <index> to add column <columnName> is larger than struct length: <length>

DELTA_INSERT_COLUMN_ARITY_MISMATCH

SQLSTATE: 42802

Cannot write to ‘<tableName>’, <columnName>; target table has <numColumns> column(s) but the inserted data has <insertColumns> column(s)

DELTA_INSERT_COLUMN_MISMATCH

SQLSTATE: 42802

Column <columnName> is not specified in INSERT

DELTA_INVALID_BUCKET_COUNT

Invalid bucket count: <invalidBucketCount>. Bucket count should be a positive number that is power of 2 and at least 8. You can use <validBucketCount> instead.

DELTA_INVALID_BUCKET_INDEX

Cannot find the bucket column in the partition columns

DELTA_INVALID_CALENDAR_INTERVAL_EMPTY

SQLSTATE: 2200P

Interval cannot be null or blank.

DELTA_INVALID_CDC_RANGE

CDC range from start <start> to end <end> was invalid. End cannot be before start.

DELTA_INVALID_CHARACTERS_IN_COLUMN_NAME

Attribute name “<columnName>” contains invalid character(s) among ” ,;{}()\n\t=”. Please use alias to rename it.

DELTA_INVALID_CHARACTERS_IN_COLUMN_NAMES

Found invalid character(s) among ‘ ,;{}()nt=’ in the column names of your schema. <advice>

DELTA_INVALID_CLONE_PATH

SQLSTATE: 22KD1

The target location for CLONE needs to be an absolute path or table name. Use an

absolute path instead of <path>.

DELTA_INVALID_COMMITTED_VERSION

The committed version is <committedVersion> but the current version is <currentVersion>. Please contact Databricks support.

DELTA_INVALID_FORMAT

Incompatible format detected.

A transaction log for Delta was found at ``<deltaRootPath>/_delta_log,

but you are trying to <operation> <path> using format(“<format>”). You must use

‘format(“delta”)’ when reading and writing to a delta table.

To learn more about Delta, see <docLink>

DELTA_INVALID_FORMAT_FROM_SOURCE_VERSION

Unsupported format. Expected version should be smaller than or equal to <expectedVersion> but was <realVersion>. Please upgrade to newer version of Delta.

DELTA_INVALID_GENERATED_COLUMN_REFERENCES

SQLSTATE: 42621

A generated column cannot use a non-existent column or another generated column

DELTA_INVALID_IDEMPOTENT_WRITES_OPTIONS

SQLSTATE: 42616

Invalid options for idempotent Dataframe writes: <reason>

DELTA_INVALID_INTERVAL

SQLSTATE: 22006

<interval> is not a valid INTERVAL.

DELTA_INVALID_ISOLATION_LEVEL

SQLSTATE: 25000

invalid isolation level ‘<isolationLevel>’

DELTA_INVALID_LOGSTORE_CONF

SQLSTATE: F0000

(<classConfig>) and (<schemeConfig>) cannot be set at the same time. Please set only one group of them.

DELTA_INVALID_MANAGED_TABLE_SYNTAX_NO_SCHEMA

You are trying to create a managed table <tableName>

Materialized <rowTrackingColumn> column name missing for <tableName>.

DELTA_MAX_ARRAY_SIZE_EXCEEDED

Please use a limit less than Int.MaxValue - 8.

DELTA_MAX_COMMIT_RETRIES_EXCEEDED

SQLSTATE: 40000

This commit has failed as it has been tried <numAttempts> times but did not succeed.

This can be caused by the Delta table being committed continuously by many concurrent

commits.

Commit started at version: <startVersion>

Commit failed at version: <failVersion>

Number of actions attempted to commit: <numActions>

Total time spent attempting this commit: <timeSpent> ms

DELTA_MAX_LIST_FILE_EXCEEDED

File list must have at most <maxFileListSize> entries, had <numFiles>.

DELTA_MERGE_INCOMPATIBLE_DECIMAL_TYPE

SQLSTATE: 42806

Failed to merge decimal types with incompatible <decimalRanges>

DELTA_MERGE_MATERIALIZE_SOURCE_FAILED_REPEATEDLY

SQLSTATE: 25000

Keeping the source of the MERGE statement materialized has failed repeatedly.

DELTA_MERGE_MISSING_WHEN

There must be at least one WHEN clause in a MERGE statement.

DELTA_MERGE_RESOLVED_ATTRIBUTE_MISSING_FROM_INPUT

Resolved attribute(s) <missingAttributes> missing from <input> in operator <merge>

DELTA_MERGE_UNEXPECTED_ASSIGNMENT_KEY

SQLSTATE: 22005

Unexpected assignment key: <unexpectedKeyClass> - <unexpectedKeyObject>

DELTA_MERGE_UNRESOLVED_EXPRESSION

Cannot resolve <sqlExpr> in <clause> given <cols>.

DELTA_METADATA_ABSENT

Couldn’t find Metadata while committing the first version of the Delta table.

DELTA_MISSING_CHANGE_DATA

Error getting change data for range [<startVersion> , <endVersion>] as change data was not

recorded for version [<version>]. If you’ve enabled change data feed on this table,

use DESCRIBE HISTORY to see when it was first enabled.

Otherwise, to start recording change data, use `ALTER TABLE table_name SET TBLPROPERTIES

(<key>=true)`.

DELTA_MISSING_COLUMN

Cannot find <columnName> in table columns: <columnList>

DELTA_MISSING_DELTA_TABLE

<tableName> is not a Delta table.

DELTA_MISSING_DELTA_TABLE_COPY_INTO

Table doesn’t exist. Create an empty Delta table first using CREATE TABLE <tableName>.

DELTA_MISSING_FILES_UNEXPECTED_VERSION

The stream from your Delta table was expecting process data from version <startVersion>,

but the earliest available version in the deltalog directory is <earliestVersion>. The files

in the transaction log may have been deleted due to log cleanup. In order to avoid losing

data, we recommend that you restart your stream with a new checkpoint location and to

increase your delta.logRetentionDuration setting, if you have explicitly set it below 30

days.

If you would like to ignore the missed data and continue your stream from where it left

off, you can set the .option(“<option>”, “false”) as part

of your readStream statement.

DELTA_MISSING_ICEBERG_CLASS

Iceberg class was not found. Please ensure Delta Iceberg support is installed.

Please refer to <docLink> for more details.

DELTA_MISSING_NOT_NULL_COLUMN_VALUE

SQLSTATE: 23502

Column <columnName>, which has a NOT NULL constraint, is missing from the data being written into the table.

DELTA_MISSING_PARTITION_COLUMN

SQLSTATE: 42KD6

Partition column <columnName> not found in schema <columnList>

DELTA_MISSING_PART_FILES

SQLSTATE: 42KD6

Couldn’t find all part files of the checkpoint version: <version>

DELTA_MISSING_PROVIDER_FOR_CONVERT

CONVERT TO DELTA only supports parquet tables. Please rewrite your target as parquet.<path> if it’s a parquet directory.

DELTA_MISSING_SET_COLUMN

SET column <columnName> not found given columns: <columnList>.

DELTA_MISSING_TRANSACTION_LOG

Incompatible format detected.

You are trying to <operation> <path> using Delta, but there is no

transaction log present. Check the upstream job to make sure that it is writing

using format(“delta”) and that you are trying to %1$s the table base path.

To learn more about Delta, see <docLink>

DELTA_MODE_NOT_SUPPORTED

Specified mode ‘<mode>’ is not supported. Supported modes are: <supportedModes>

DELTA_MULTIPLE_CDC_BOUNDARY

SQLSTATE: 42614

Multiple <startingOrEnding> arguments provided for CDC read. Please provide one of either <startingOrEnding>Timestamp or <startingOrEnding>Version.

DELTA_MULTIPLE_CONF_FOR_SINGLE_COLUMN_IN_BLOOM_FILTER

SQLSTATE: 42614

Multiple bloom filter index configurations passed to command for column: <columnName>

DELTA_MULTIPLE_SOURCE_ROW_MATCHING_TARGET_ROW_IN_MERGE

SQLSTATE: 21506

Cannot perform Merge as multiple source rows matched and attempted to modify the same

target row in the Delta table in possibly conflicting ways. By SQL semantics of Merge,

when multiple source rows match on the same target row, the result may be ambiguous

as it is unclear which source row should be used to update or delete the matching

target row. You can preprocess the source table to eliminate the possibility of

multiple matches. Please refer to

<usageReference>

DELTA_NAME_CONFLICT_IN_BUCKETED_TABLE

The following column name(s) are reserved for Delta bucketed table internal usage only: <names>

DELTA_NESTED_FIELDS_NEED_RENAME

Nested fields need renaming to avoid data loss. Fields:

<fields>.

Original schema:

<schema>

DELTA_NESTED_NOT_NULL_CONSTRAINT

The <nestType> type of the field <parent> contains a NOT NULL constraint. Delta does not support NOT NULL constraints nested within arrays or maps. To suppress this error and silently ignore the specified constraints, set <configKey> = true.

Parsed <nestType> type:

<nestedPrettyJson>

DELTA_NESTED_SUBQUERY_NOT_SUPPORTED

Nested subquery is not supported in the <operation> condition.

DELTA_NEW_CHECK_CONSTRAINT_VIOLATION

SQLSTATE: 23512

<numRows> rows in <tableName> violate the new CHECK constraint (<checkConstraint>)

DELTA_NEW_NOT_NULL_VIOLATION

SQLSTATE: 23512

<numRows> rows in <tableName> violate the new NOT NULL constraint on <colName>

DELTA_NON_BOOLEAN_CHECK_CONSTRAINT

SQLSTATE: 42621

CHECK constraint ‘<name>’ (<expr>) should be a boolean expression.

DELTA_NON_DETERMINISTIC_FUNCTION_NOT_SUPPORTED

Non-deterministic functions are not supported in the <operation> <expression>

DELTA_NON_GENERATED_COLUMN_MISSING_UPDATE_EXPR

<columnName> is not a generated column but is missing its update expression

DELTA_NON_LAST_MATCHED_CLAUSE_OMIT_CONDITION

When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.

DELTA_NON_LAST_NOT_MATCHED_BY_SOURCE_CLAUSE_OMIT_CONDITION

When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.

DELTA_NON_LAST_NOT_MATCHED_CLAUSE_OMIT_CONDITION

When there are more than one NOT MATCHED clauses in a MERGE statement, only the last NOT MATCHED clause can omit the condition

DELTA_NON_PARSABLE_TAG

Could not parse tag <tag>.

File tags are: <tagList>

DELTA_NON_PARTITION_COLUMN_ABSENT

SQLSTATE: KD005

Data written into Delta needs to contain at least one non-partitioned column.<details>

DELTA_NON_PARTITION_COLUMN_REFERENCE

Predicate references non-partition column ‘<columnName>’. Only the partition columns may be referenced: [<columnList>]

DELTA_NON_PARTITION_COLUMN_SPECIFIED

Non-partitioning column(s) <columnList> are specified where only partitioning columns are expected: <fragment>.

DELTA_NON_SINGLE_PART_NAMESPACE_FOR_CATALOG

Delta catalog requires a single-part namespace, but <identifier> is multi-part.

DELTA_NOT_A_DATABRICKS_DELTA_TABLE

<table> is not a Delta table. Please drop this table first if you would like to create it with Databricks Delta.

DELTA_NOT_A_DELTA_TABLE

<tableName> is not a Delta table. Please drop this table first if you would like to recreate it with Delta Lake.

DELTA_NOT_NULL_COLUMN_NOT_FOUND_IN_STRUCT

Not nullable column not found in struct: <struct>

DELTA_NOT_NULL_CONSTRAINT_VIOLATED

SQLSTATE: 23502

NOT NULL constraint violated for column: <columnName>.

DELTA_NOT_NULL_NESTED_FIELD

A non-nullable nested field can’t be added to a nullable parent. Please set the nullability of the parent column accordingly.

DELTA_NO_COMMITS_FOUND

SQLSTATE: KD006

No commits found at <logPath>

DELTA_NO_NEW_ATTRIBUTE_ID

Could not find a new attribute ID for column <columnName>. This should have been checked earlier.

DELTA_NO_RECREATABLE_HISTORY_FOUND

SQLSTATE: KD006

No recreatable commits found at <logPath>

DELTA_NO_RELATION_TABLE

Table <tableIdent> not found

DELTA_NO_START_FOR_CDC_READ

No startingVersion or startingTimestamp provided for CDC read.

DELTA_NULL_SCHEMA_IN_STREAMING_WRITE

SQLSTATE: 42P18

Delta doesn’t accept NullTypes in the schema for streaming writes.

DELTA_ONEOF_IN_TIMETRAVEL

Please either provide ‘timestampAsOf’ or ‘versionAsOf’ for time travel.

DELTA_ONLY_OPERATION

<operation> is only supported for Delta tables.

DELTA_OPERATION_MISSING_PATH

Please provide the path or table identifier for <operation>.

DELTA_OPERATION_NOT_ALLOWED

Operation not allowed: <operation> is not supported for Delta tables

DELTA_OPERATION_NOT_ALLOWED_DETAIL

Operation not allowed: <operation> is not supported for Delta tables: <tableName>

DELTA_OPERATION_ON_TEMP_VIEW_WITH_GENERATED_COLS_NOT_SUPPORTED

<operation> command on a temp view referring to a Delta table that contains generated columns is not supported. Please run the <operation> command on the Delta table directly

DELTA_OVERWRITE_MUST_BE_TRUE

Copy option overwriteSchema cannot be specified without setting OVERWRITE = ‘true’.

DELTA_OVERWRITE_SCHEMA_WITH_DYNAMIC_PARTITION_OVERWRITE

‘overwriteSchema’ cannot be used in dynamic partition overwrite mode.

DELTA_PARTITION_COLUMN_CAST_FAILED

SQLSTATE: 22525

Failed to cast value <value> to <dataType> for partition column <columnName>

DELTA_PARTITION_COLUMN_NOT_FOUND

Partition column <columnName> not found in schema [<schemaMap>]

DELTA_PARTITION_SCHEMA_IN_ICEBERG_TABLES

Partition schema cannot be specified when converting Iceberg tables. It is automatically inferred.

DELTA_PATH_DOES_NOT_EXIST

<path> doesn’t exist

DELTA_PATH_EXISTS

SQLSTATE: 42K04

Cannot write to already existent path <path> without setting OVERWRITE = ‘true’.

DELTA_POST_COMMIT_HOOK_FAILED

SQLSTATE: 2DKD0

Committing to the Delta table version <version> succeeded but error while executing post-commit hook <name>``<message>

DELTA_PROTOCOL_PROPERTY_NOT_INT

SQLSTATE: 42K06

Protocol property <key> needs to be an integer. Found <value>

DELTA_READ_FEATURE_PROTOCOL_REQUIRES_WRITE

SQLSTATE: KD004

Unable to upgrade only the reader protocol version to use table features. Writer protocol version must be at least <writerVersion> to proceed. Refer to <docLink> for more information on table protocol versions.

DELTA_READ_TABLE_WITHOUT_COLUMNS

SQLSTATE: 428GU

You are trying to read a Delta table <tableName> that does not have any columns.

Write some new data with the option mergeSchema = true to be able to read the table.

DELTA_REGEX_OPT_SYNTAX_ERROR

SQLSTATE: 2201B

Please recheck your syntax for ‘<regExpOption>’

DELTA_REMOVE_FILE_CDC_MISSING_EXTENDED_METADATA

RemoveFile created without extended metadata is ineligible for CDC:

<file>

DELTA_REPLACE_WHERE_IN_OVERWRITE

You can’t use replaceWhere in conjunction with an overwrite by filter

DELTA_REPLACE_WHERE_MISMATCH

SQLSTATE: 44000

Data written out does not match replaceWhere ‘<replaceWhere>’.

<message>

DELTA_REPLACE_WHERE_WITH_DYNAMIC_PARTITION_OVERWRITE

A ‘replaceWhere’ expression and ‘partitionOverwriteMode’=’dynamic’ cannot both be set in the DataFrameWriter options.

DELTA_REPLACE_WHERE_WITH_FILTER_DATA_CHANGE_UNSET

‘replaceWhere’ cannot be used with data filters when ‘dataChange’ is set to false. Filters: <dataFilters>

DELTA_ROW_ID_ASSIGNMENT_WITHOUT_STATS

Cannot assign row IDs without row count statistics.

Collect statistics for the table by running the following code in a Scala notebook and retry:

import com.databricks.sql.transaction.tahoe.DeltaLog

import com.databricks.sql.transaction.tahoe.stats.StatisticsCollection

import org.apache.spark.sql.catalyst.TableIdentifier

val log = DeltaLog.forTable(spark, TableIdentifier(table_name))

StatisticsCollection.recompute(spark, log)

DELTA_SCHEMA_CHANGED

Detected schema change:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory.

DELTA_SCHEMA_CHANGED_WITH_STARTING_OPTIONS

Detected schema change in version <version>:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory. If the issue persists after

changing to a new checkpoint directory, you may need to change the existing

‘startingVersion’ or ‘startingTimestamp’ option to start from a version newer than

<version> with a new checkpoint directory.

DELTA_SCHEMA_CHANGED_WITH_VERSION

Detected schema change in version <version>:

streaming source schema: <readSchema>

data file schema: <dataSchema>

Please try restarting the query. If this issue repeats across query restarts without

making progress, you have made an incompatible schema change and need to start your

query from scratch using a new checkpoint directory.

DELTA_SCHEMA_CHANGE_SINCE_ANALYSIS

The schema of your Delta table has changed in an incompatible way since your DataFrame

or DeltaTable object was created. Please redefine your DataFrame or DeltaTable object.

Changes:

DELTA_SCHEMA_NOT_CONSISTENT_WITH_TARGET

The table schema <tableSchema> is not consistent with the target attributes: <targetAttrs>

DELTA_SCHEMA_NOT_PROVIDED

SQLSTATE: 42908

Table schema is not provided. Please provide the schema (column definition) of the table when using REPLACE table and an AS SELECT query is not provided.

DELTA_SCHEMA_NOT_SET

SQLSTATE: KD008

Table schema is not set. Write data into it or use CREATE TABLE to set the schema.

DELTA_SET_LOCATION_SCHEMA_MISMATCH

The schema of the new Delta location is different than the current table schema.

original schema:

<original>

destination schema:

<destination>

If this is an intended change, you may turn this check off by running:

%%sql set <config> = true

DELTA_SHALLOW_CLONE_FILE_NOT_FOUND

File <filePath> referenced in the transaction log cannot be found. This can occur when data has been manually deleted from the file system rather than using the table DELETE statement. This table appears to be a shallow clone, if that is the case, this error can occur when the original table from which this table was cloned has deleted a file that the clone is still using. If you want any clones to be independent of the original table, use a DEEP clone instead.

DELTA_SHOW_PARTITION_IN_NON_PARTITIONED_COLUMN

Non-partitioning column(s) <badCols> are specified for SHOW PARTITIONS

DELTA_SHOW_PARTITION_IN_NON_PARTITIONED_TABLE

SHOW PARTITIONS is not allowed on a table that is not partitioned: <tableName>

DELTA_SOURCE_IGNORE_DELETE

Detected deleted data (for example <removedFile>) from streaming source at version <version>. This is currently not supported. If you’d like to ignore deletes, set the option ‘ignoreDeletes’ to ‘true’. The source table can be found at path <dataPath>.

DELTA_SOURCE_TABLE_IGNORE_CHANGES

Detected a data update (for example <file>) in the source table at version <version>. This is currently not supported. If you’d like to ignore updates, set the option ‘skipChangeCommits’ to ‘true’. If you would like the data update to be reflected, please restart this query with a fresh checkpoint directory. The source table can be found at path <dataPath>.

DELTA_SPARK_SESSION_NOT_SET

Active SparkSession not set.

DELTA_SPARK_THREAD_NOT_FOUND

Not running on a Spark task thread

DELTA_STARTING_VERSION_AND_TIMESTAMP_BOTH_SET

Please either provide ‘<version>’ or ‘<timestamp>’

DELTA_STATE_RECOVER_ERROR

The <operation> of your Delta table could not be recovered while Reconstructing

version: <version>. Did you manually delete files in the deltalog directory?

DELTA_STATS_COLLECTION_COLUMN_NOT_FOUND

<statsType> stats not found for column in Parquet metadata: <columnPath>.

DELTA_STREAMING_CANNOT_CONTINUE_PROCESSING_POST_SCHEMA_EVOLUTION

We’ve detected a non-additive schema change (<opType>) at Delta version <schemaChangeVersion> in the Delta streaming source. Please check if you want to manually propagate this schema change to the sink table before we proceed with stream processing.

Once you have fixed the schema of the sink table or have decided there is no need to fix, you can set (one of) the following SQL configurations to unblock this non-additive schema change and continue stream processing.

To unblock for this particular stream just for this single schema change: set <allowCkptVerKey>` = `<allowCkptVerValue>.

To unblock for this particular stream: set <allowCkptKey>` = `<allowCkptValue>

To unblock for all streams: set <allowAllKey>` = `<allowAllValue>.

Alternatively if applicable, you may replace the <allowAllMode> with <opSpecificMode> in the SQL conf to unblock stream for just this schema change type.

DELTA_STREAMING_CHECK_COLUMN_MAPPING_NO_SNAPSHOT

Failed to obtain Delta log snapshot for the start version when checking column mapping schema changes. Please choose a different start version, or force enable streaming read at your own risk by setting ‘<config>’ to ‘true’.

DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE

SQLSTATE: 42KD4

Streaming read is not supported on tables with read-incompatible schema changes (e.g. rename or drop or datatype changes).

For further information and possible next steps to resolve this issue, please review the documentation at <docLink>

Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.

DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE_USE_SCHEMA_LOG

SQLSTATE: 42KD4

Streaming read is not supported on tables with read-incompatible schema changes (e.g. rename or drop or datatype changes).

Please provide a ‘schemaTrackingLocation’ to enable non-additive schema evolution for Delta stream processing.

See <docLink> for more details.

Read schema: <readSchema>. Incompatible data schema: <incompatibleSchema>.

DELTA_STREAMING_METADATA_EVOLUTION

The schema, table configuration or protocol of your Delta table has changed during streaming.

The schema or metadata tracking log has been updated.

Please restart the stream to continue processing using the updated metadata.

Updated schema: <schema>.

Updated table configurations: <config>.

Updated table protocol: <protocol>

DELTA_STREAMING_SCHEMA_EVOLUTION_UNSUPPORTED_ROW_FILTER_COLUMN_MASKS

Streaming from source table <tableId> with schema tracking does not support row filters or column masks.

Please drop the row filters or column masks, or disable schema tracking.

DELTA_STREAMING_SCHEMA_LOCATION_CONFLICT

Detected conflicting schema location ‘<loc>’ while streaming from table or table located at ‘<table>’.

Another stream may be reusing the same schema location, which is not allowed.

Please provide a new unique schemaTrackingLocation path or streamingSourceTrackingId as a reader option for one of the streams from this table.

DELTA_STREAMING_SCHEMA_LOCATION_NOT_UNDER_CHECKPOINT

Schema location ‘<schemaTrackingLocation>’ must be placed under checkpoint location ‘<checkpointLocation>’.

We could not initialize the Delta streaming source schema log because

we detected an incompatible schema or protocol change while serving a streaming batch from table version <a> to <b>.

DELTA_STREAMING_SCHEMA_LOG_PARSE_SCHEMA_FAILED

Failed to parse the schema from the Delta streaming source schema log.

The schema log may have been corrupted. Please pick a new schema location.

DELTA_TABLE_ALREADY_CONTAINS_CDC_COLUMNS

SQLSTATE: 42711

Unable to enable Change Data Capture on the table. The table already contains

reserved columns <columnList> that will

be used internally as metadata for the table’s Change Data Feed. To enable

Change Data Feed on the table rename/drop these columns.

DELTA_TABLE_ALREADY_EXISTS

Table <tableName> already exists.

DELTA_TABLE_FOR_PATH_UNSUPPORTED_HADOOP_CONF

Currently DeltaTable.forPath only supports hadoop configuration keys starting with <allowedPrefixes> but got <unsupportedOptions>

DELTA_TABLE_FOUND_IN_EXECUTOR

DeltaTable cannot be used in executors

DELTA_TABLE_LOCATION_MISMATCH

The location of the existing table <tableName> is <existingTableLocation>. It doesn’t match the specified location <tableLocation>.

DELTA_TABLE_NOT_FOUND

Delta table <tableName> doesn’t exist.

DELTA_TABLE_NOT_SUPPORTED_IN_OP

Table is not supported in <operation>. Please use a path instead.

DELTA_TABLE_ONLY_OPERATION

<tableName> is not a Delta table. <operation> is only supported for Delta tables.

DELTA_TARGET_TABLE_FINAL_SCHEMA_EMPTY

SQLSTATE: 428GU

Target table final schema is empty.

DELTA_TIMESTAMP_GREATER_THAN_COMMIT

SQLSTATE: 42816

The provided timestamp (<providedTimestamp>) is after the latest version available to this

table (<tableName>). Please use a timestamp before or at <maximumTimestamp>.

DELTA_TIMESTAMP_INVALID

SQLSTATE: 42816

The provided timestamp (<expr>) cannot be converted to a valid timestamp.

DELTA_TIME_TRAVEL_INVALID_BEGIN_VALUE

<timeTravelKey> needs to be a valid begin value.

DELTA_TRUNCATED_TRANSACTION_LOG

<path>: Unable to reconstruct state at version <version> as the transaction log has been truncated due to manual deletion or the log retention policy (<logRetentionKey>=<logRetention>) and checkpoint retention policy (<checkpointRetentionKey>=<checkpointRetention>)

DELTA_TRUNCATE_TABLE_PARTITION_NOT_SUPPORTED

Operation not allowed: TRUNCATE TABLE on Delta tables does not support partition predicates; use DELETE to delete specific partitions or rows.

DELTA_TXN_LOG_FAILED_INTEGRITY

Change files found in a dataChange = false transaction. Files:

<fileList>

DELTA_UNEXPECTED_NUM_PARTITION_COLUMNS_FROM_FILE_NAME

SQLSTATE: KD009

Expecting <expectedColsSize> partition column(s): <expectedCols>, but found <parsedColsSize> partition column(s): <parsedCols> from parsing the file name: <path>

DELTA_UNEXPECTED_PARTIAL_SCAN

SQLSTATE: KD00A

Expect a full scan of Delta sources, but found a partial scan. path:<path>

DELTA_UNEXPECTED_PARTITION_COLUMN_FROM_FILE_NAME

SQLSTATE: KD009

Expecting partition column <expectedCol>, but found partition column <parsedCol> from parsing the file name: <path>

DELTA_UNEXPECTED_PARTITION_SCHEMA_FROM_USER

SQLSTATE: KD009

Your current table protocol version does not support changing column mapping modes

using <config>.

Required Delta protocol version for column mapping:

<requiredVersion>

Your table’s current Delta protocol version:

<currentVersion>

<advice>

DELTA_UNSUPPORTED_COLUMN_MAPPING_SCHEMA_CHANGE

Schema change is detected:

Expecting the status for table feature <feature> to be “supported”, but got “<status>”.

DELTA_UNSUPPORTED_FIELD_UPDATE_NON_STRUCT

Updating nested fields is only supported for StructType, but you are trying to update a field of <columnName>, which is of type: <dataType>.

DELTA_UNSUPPORTED_FSCK_WITH_DELETION_VECTORS

The ‘FSCK REPAIR TABLE’ command is not supported on table versions with missing deletion vector files.

Please contact support.

DELTA_UNSUPPORTED_GENERATE_WITH_DELETION_VECTORS

The ‘GENERATE symlink_format_manifest’ command is not supported on table versions with deletion vectors.

In order to produce a version of the table without deletion vectors, run ‘REORG TABLE table APPLY (PURGE)’. Then re-run the ‘GENERATE’ command.

For more details see DELTA_VERSIONS_NOT_CONTIGUOUS

DELTA_VIOLATE_CONSTRAINT_WITH_VALUES

SQLSTATE: 23001

CHECK constraint <constraintName> <expression> violated by row with values:

<values>

DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED

The validation of the properties of table <table> has been violated:

For more details see DELTA_VIOLATE_TABLE_PROPERTY_VALIDATION_FAILED

DELTA_WRITE_INTO_VIEW_NOT_SUPPORTED

<viewIdentifier> is a view. You may not write data into a view.

DELTA_ZORDERING_COLUMN_DOES_NOT_EXIST

Z-Ordering column <columnName> does not exist in data schema.

DELTA_ZORDERING_ON_COLUMN_WITHOUT_STATS

SQLSTATE: KD00D

Z-Ordering on <cols> will be

ineffective, because we currently do not collect stats for these columns. Please refer to

<link>

for more information on data skipping and z-ordering. You can disable

this check by setting

‘%%sql set <zorderColStatKey> = false’

DELTA_ZORDERING_ON_PARTITION_COLUMN

<colName> is a partition column. Z-Ordering can only be performed on data columns

Autoloader

CF_ADD_NEW_NOT_SUPPORTED

Schema evolution mode <addNewColumnsMode> is not supported when the schema is specified. To use this mode, you can provide the schema through cloudFiles.schemaHints instead.

CF_AMBIGUOUS_AUTH_OPTIONS_ERROR

Found notification-setup authentication options for the (default) directory

listing mode:

<options>

If you wish to use the file notification mode, please explicitly set:

.option(“cloudFiles.<useNotificationsKey>”, “true”)

Alternatively, if you want to skip the validation of your options and ignore these

authentication options, you can set:

.option(“cloudFiles.ValidateOptionsKey>”, “false”)

CF_AMBIGUOUS_INCREMENTAL_LISTING_MODE_ERROR

Incremental listing mode (cloudFiles.<useIncrementalListingKey>)

and file notification (cloudFiles.<useNotificationsKey>)

To fix you can either:

Grant write permissions to the source directory OR
Set cleanSource to ‘OFF’

You could also unblock your stream by setting the SQLConf spark.databricks.cloudFiles.cleanSource.disabledDueToAuthorizationErrors to ‘true’.

CF_DUPLICATE_COLUMN_IN_DATA

There was an error when trying to infer the partition schema of your table. You have the same column duplicated in your data and partition paths. To ignore the partition value, please provide your partition columns explicitly by using: .option(“cloudFiles.<partitionColumnsKey>”, “{comma-separated-list}”)

CF_EMPTY_DIR_FOR_SCHEMA_INFERENCE