[SPARK-37300] TaskSchedulerImpl should ignore task finished event if its task was already finished state

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0
• Component/s: Spark Core
• Assignee: hujiahua
• Reporter: hujiahua
• Created: 12/Nov/21 07:18
• Updated: 13/Dec/21 03:02
• Resolved: 13/Dec/21 03:02

Description

`TaskSchedulerImpl` handle task finished event at `handleSuccessfulTask` and `handleFailedTask` , but in some case the task was already finished state, which we should ignore task finished event.

Case describe:
when a executor finished a task of some stage, the driver will receive a StatusUpdate event to handle it. At the same time the driver found the executor heartbeat timed out, so the dirver also need handle ExecutorLost event simultaneously. There was a race condition issues here, which will make TaskSetManager.successful and TaskSetManager.tasksSuccessful wrong result. More detailed description and discussion can be viewed at https://issues.apache.org/jira/browse/SPARK-36575 and https://github.com/apache/spark/pull/33872

Issue Links

• links to: [Github] Pull Request #34578 (sleep1661)