[YUNIKORN-578] support dynamic queues with namespace tagged quota and task group

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10
• Fix Version/s: 0.10
• Component/s: core - scheduler
• Labels: pull-request-available
• Target Version: 0.10
• Assignee: Wilfred Spiegelenburg
• Reporter: Wilfred Spiegelenburg
• Created: 17/Mar/21 01:57
• Updated: 21/Jan/22 21:48
• Resolved: 17/Mar/21 04:53

Description

If you create an application with gang scheduling enabled the total gang size should be checked against the queue max resource (YUNIKORN-520)

This check fails if you use placement rules (dynamic queue creation) using namespace annotations for:

• queue name (tag rule)
• namespace quotas

Only the first application submitted to the namespace will not behave as expected. The queue will be created but the quota on the queue is not set until after the quota checks are performed. The result is that the application will be added to the queue but should have been rejected. The application will never be properly scheduled as the gang request can never be satisfied.

For subsequent applications the quota will have been set (even if the first app is a non gang app) and will be rejected as expected.

Issue Links

• links to: GitHub Pull Request #259