[YARN-9483] DistributedShell does not release container when failed to localize at launch

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Assignee: Prabhu Joseph
• Reporter: Prabhu Joseph
• Created: 15/Apr/19 09:42
• Updated: 23/Oct/19 16:14
• Resolved: 09/May/19 18:01

Description

DistributedShell does not release container when failed to localize at launch. The launch threads does not increment completed & failed containers when failed to localize. And the main thread waits for the containers to complete without failing the job.

yarn jar /HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.2.0.jar -shell_command ls  -shell_args / -jar  /HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.2.0.jar -localize_files /tmp/prabhu

Issue Links

• is required by: YARN-9008 Extend YARN distributed shell with file localization feature