[SPARK-23532] [STANDALONE] Improve data locality when launching new executors for dynamic allocation

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.3.0
• Component/s: Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: liuxian
• Created: 28/Feb/18 07:26
• Updated: 25/May/21 01:50
• Resolved: 25/May/21 01:39

Description

Currently Spark on Yarn supports better data locality by considering the preferred locations of the pending tasks when dynamic allocation is enabled, refer to https://issues.apache.org/jira/browse/SPARK-4352.

Mesos alse supports data locality, refer to https://issues.apache.org/jira/browse/SPARK-16944

It would be better that Standalone can also support this feature.

Issue Links

• links to: [Github] Pull Request #20690 (10110346)
• links to: GitHub Pull Request #20690