[SPARK-16650] Improve documentation of spark.task.maxFailures

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.2
• Fix Version/s: 2.0.1
• Component/s: Documentation
• Assignee: Thomas Graves
• Reporter: Thomas Graves
• Created: 20/Jul/16 13:38
• Updated: 22/Jul/16 11:42
• Resolved: 22/Jul/16 11:42

Description

The documentation for spark.task.maxFailures isn't clear as to whether this is just the number of total task failures or if its a single task failing multiple attempts.

It turns out its the latter, a single task has to fail spark.task.maxFailures number of attempts before it fails the job.

We should try to make that more clear in docs.

Issue Links

• links to: [Github] Pull Request #14287 (tgravescs)