[SPARK-29306] Executors need to track what ResourceProfile they are created with

• Type: Story
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Spark Core
• Epic Link: Stage Level Scheduling
• Assignee: Thomas Graves
• Reporter: Thomas Graves
• Created: 30/Sep/19 17:17
• Updated: 03/Feb/20 22:15
• Resolved: 17/Jan/20 14:16

Description

For stage level scheduling, the Executors need to report what ResourceProfile they are created with so that the ExecutorMonitor can track them and the ExecutorAllocationManager can use that information to know how many to request, etc.

Issue Links

• links to: GitHub Pull Request #26682