[YARN-11185] Pending app metrics are increased doubly when a queue reaches its max-parallel-apps limit

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: capacity scheduler
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: András Győri
• Reporter: András Győri
• Created: 15/Jun/22 11:31
• Updated: 28/Jan/24 05:19
• Resolved: 20/Jun/22 13:05

Description

When an application is submitted to a queue, its pending app metric is increased, even, if the application reached the queue's max-parallel-apps limit. If this application is allowed to run in the future because some other application is finished, the application is submitted to the queue again, increasing the pending app queue and user metrics again. Even if the application finishes, it can only decrease the pending metric by one, which makes the pending app metric monotonically increasing, whereas the ideal state should eventually be 0.

Issue Links

• links to: GitHub Pull Request #4442