Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.1.3, 3.2.2, 3.3.1
Description
Currently, we will always rerun a finished shuffle map task if it once runs the lost executor. However, in the case of the executor loss is caused by decommission, the shuffle data might be migrated so that task doesn't need to rerun.
Attachments
Issue Links
- is related to
-
SPARK-49472 Resubmit the task on executor decommission
- Resolved
- links to