Details
-
Sub-task
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
None
-
None
Description
export SPARK_JAVA_OPTS="-server -Dspark.ui.killEnabled=false -Dspark.akka.askTimeout=120 -Dspark.akka.timeout=120 -Dspark.locality.wait=10000 -Dspark.storage.blockManagerTimeoutIntervalMs=6000000 -Dspark.storage.memoryFraction=0.7 -Dspark.broadcast.factory=org.apache.spark.broadcast.TorrentBroadcastFactory"
Executor fails to start.
export SPARK_JAVA_OPTS="-Dspark.ui.killEnabled=false -Dspark.akka.askTimeout=120 -Dspark.akka.timeout=120 -Dspark.locality.wait=10000 -Dspark.storage.blockManagerTimeoutIntervalMs=6000000 -Dspark.storage.memoryFraction=0.7 -Dspark.broadcast.factory=org.apache.spark.broadcast.TorrentBroadcastFactory"
Executor can work
Attachments
Attachments
Issue Links
- is duplicated by
-
SPARK-1638 Executors fail to come up if "spark.executor.extraJavaOptions" is set
- Resolved