To fine tune Spark jobs, you can provide custom Spark configuration properties at the bottom of the cluster creation page.
In addition to Spark configuration properties, you can provide environment variables that you can access from scripts running on the cluster. See
spark_env_vars in Create cluster request structure.
This feature is supported only in the API.