[SPARK-11120] maxNumExecutorFailures defaults to 3 under dynamic allocation

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.5.1
• Fix Version/s: 1.6.0
• Component/s: Spark Core
• Target Version/s: 1.6.0
• Assignee: Ryan Williams
• Reporter: Ryan Williams
• Created: 15/Oct/15 00:35
• Updated: 19/Oct/15 23:33
• Resolved: 19/Oct/15 23:33

Description

With dynamic allocation, the spark.executor.instances config is 0, meaning this line ends up with maxNumExecutorFailures equal to 3, which for me has resulted in large dynamicAllocation jobs with hundreds of executors dying due to one bad node serially failing executors that are allocated on it.

I think that using spark.dynamicAllocation.maxExecutors would make most sense in this case; I frequently run shells that vary between 1 and 1000 executors, so using s.dA.minExecutors or s.dA.initialExecutors would still leave me with a value that is lower than makes sense.

Issue Links

• links to: [Github] Pull Request #9147 (ryan-williams)