[FLINK-14189] Extend TaskExecutor to support dynamic slot allocation

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Done
• Fix Version/s: 1.10.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Xintong Song
• Reporter: Xintong Song
• Created: 24/Sep/19 11:23
• Updated: 08/Dec/19 22:18
• Resolved: 08/Dec/19 22:18

Description

• TaskSlotTable
  • Bookkeep task manager available resources
  • Add and implement interface for dynamic allocating slot (with resource profile instead of slot index)
  • Create slot report with dynamic allocated slots and remaining available resources
• TaskExecutor
  • Support request slot with resource profile rather than slot id.

The slot report still contain status of legacy free slots. When ResourceManager requests slots with slot id, convert it to default slot resource profiles for bookkeeping.

Issue Links

• links to: GitHub Pull Request #10330