Skip to main content

INVALID_SPARK_CONFIG error condition

SQLSTATE: 42616

Invalid Spark config:

INVALID_EXECUTOR_HEARTBEAT_INTERVAL

The value of <networkTimeoutKey>=<networkTimeoutValue>ms must be greater than the value of <executorHeartbeatIntervalKey>=<executorHeartbeatIntervalValue>ms.

INVALID_EXECUTOR_MEMORY_OPTIONS

<executorOptsKey> is not allowed to specify max heap memory settings (was '<javaOpts>'). Use spark.executor.memory instead.

INVALID_EXECUTOR_SPARK_OPTIONS

<executorOptsKey> is not allowed to set Spark options (was '<javaOpts>'). Set them directly on a SparkConf or in a properties file when using ./bin/spark-submit.

INVALID_MEMORY_FRACTION

<memoryFractionKey> should be between 0 and 1 (was '<memoryFractionValue>').

INVALID_SPARK_SUBMIT_DEPLOY_MODE_KEY

<sparkSubmitDeployModeKey> can only be "cluster" or "client".

NETWORK_AUTH_MUST_BE_ENABLED

<networkAuthEnabledConf> must be enabled when enabling encryption.