[SPARK-20358] Executors failing stage on interrupted exception thrown by cancelled tasks

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: Spark Core
• Assignee: Eric Liang
• Reporter: Eric Liang
• Created: 17/Apr/17 19:13
• Updated: 14/Jul/17 07:31
• Resolved: 20/Apr/17 16:55

Description

https://issues.apache.org/jira/browse/SPARK-20217 introduced a regression where now interrupted exceptions will cause a task to fail on cancellation. This is because NonFatal(e) does not match if e is an InterrupedException.

Issue Links

• contains: SPARK-19293 Spark 2.1.x unstable with spark.speculation=true
• is broken by: SPARK-20217 Executor should not fail stage if killed task throws non-interrupted exception
• links to: [Github] Pull Request #17659 (ericl)