[FLINK-31744] Extend Adaptive Scheduler sparse EG to contain maxParallelism

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.18.0
• Component/s: Runtime / Coordination, Runtime / REST
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 06/Apr/23 13:15
• Updated: 16/Oct/23 12:01
• Resolved: 12/Apr/23 08:20

Description

When a job is WaitingForResources the adpative scheduler returns a sparse execution graph that omits many details that are only know at execution time (like subtasks).

We could include all JobVertex-level information though, which would cover things like the vertex id/name and the maxParallelism.

Issue Links

• is related to: FLINK-31316 FLIP-291: Externalized Declarative Resource Management
• links to: GitHub Pull Request #22364