[YARN-11463] Node Labels root directory creation doesn't have a retry logic

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: capacity scheduler
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Ashutosh Gupta
• Reporter: Benjamin Teke
• Created: 12/Apr/23 15:29
• Updated: 25/Jan/24 14:57
• Resolved: 21/Apr/23 12:07

Description

When CS is initialized, it'll try to create the configured node labels root dir. This however doesn't implement any kind of retry logic (in contrast to the RM FS state store or ZK state store), hence if the distributed file system is unavailable at the exact moment CS tries to start it'll fail. A retry logic could be implemented to improve the robustness of the startup process.

Issue Links

• links to: GitHub Pull Request #5562
• links to: GitHub Pull Request #5614
• links to: GitHub Pull Request #5670