Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1652 Fixes and improvements for spark-submit/configs
  3. SPARK-1609

Executor fails to start when Command.extraJavaOptions contains multiple Java options

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 1.0.0
    • Spark Core
    • None

    Description

      export SPARK_JAVA_OPTS="-server -Dspark.ui.killEnabled=false -Dspark.akka.askTimeout=120 -Dspark.akka.timeout=120 -Dspark.locality.wait=10000 -Dspark.storage.blockManagerTimeoutIntervalMs=6000000 -Dspark.storage.memoryFraction=0.7 -Dspark.broadcast.factory=org.apache.spark.broadcast.TorrentBroadcastFactory"
      

      Executor fails to start.

      export SPARK_JAVA_OPTS="-Dspark.ui.killEnabled=false -Dspark.akka.askTimeout=120 -Dspark.akka.timeout=120 -Dspark.locality.wait=10000 -Dspark.storage.blockManagerTimeoutIntervalMs=6000000 -Dspark.storage.memoryFraction=0.7 -Dspark.broadcast.factory=org.apache.spark.broadcast.TorrentBroadcastFactory"
      

      Executor can work

      Attachments

        1. spark.log
          31 kB
          Guoqiang Li

        Issue Links

          Activity

            People

              gq Guoqiang Li
              witgo Guoqiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: