how to add JVM option -Xss512m to spark-submit?

Question

How to add JVM option -Xss512m to spark-submit?

In other words, where do I have to use spark.executor.extraJavaOptions and spark.driver.extraJavaOptions?

Answer 1

The Java options have to be specified via the conf parameter so ideally what you will be doing is:

spark-submit --class YOUR_MAIN_CLASS --conf "spark.executor.extraJavaOptions=-Xss512m" 
                                     --conf "spark.driver.extraJavaOptions=-Xss512m" APP.jar