[SPARK-27065] avoid more than one active task set managers for a stage

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.3, 2.4.0
• Fix Version/s: 2.3.4, 2.4.1, 3.0.0
• Component/s: Scheduler, Spark Core
• Assignee: Wenchen Fan
• Reporter: Wenchen Fan
• Created: 05/Mar/19 16:56
• Updated: 17/May/20 17:46
• Resolved: 06/Mar/19 18:02

Issue Links

• is related to: SPARK-23433 java.lang.IllegalStateException: more than one active taskSet for stage
• is related to: SPARK-25250 Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple times
• links to: [Github] Pull Request #23927 (cloud-fan)
• links to: GitHub Pull Request #23927