[FLINK-32165] Improve observability of fine-grained resource management

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.18.0
• Component/s: Runtime / Coordination, Runtime / Web Frontend
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 23/May/23 13:37
• Updated: 29/Aug/23 14:38
• Resolved: 25/Jul/23 16:41

Description

Right now fine-grained resource management is way too much of a black-box, with the only source of information being the taskmanager rest endpoints.

While this is fine-ish for services built around it the developer experience is suffering greatly and it becomes impossible to reason about the system afterwards (because we don't even log anything).

Issue Links

• is related to: FLINK-32803 Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management
• mentioned in: Page Loading...

Sub-Tasks

• Show unassigned/total TM resources in web ui: Closed
• Log dynamic slot creation on task manager: Closed
• Log required/available resources in RM: Closed
• Show allocated slots on TM page: Resolved