[YARN-8552] [DS] Container report fails for distributed containers

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Target Version/s: 3.1.4
• Assignee: Bilwa S T
• Reporter: Bibin Chundatt
• Created: 19/Jul/18 12:21
• Updated: 13/May/20 17:28
• Resolved: 13/May/20 17:28

Description

2018-07-19 19:15:02,281 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1531994217928_0003_01_1099511627753 Container Transitioned from ACQUIRED to RUNNING
2018-07-19 19:15:02,384 ERROR org.apache.hadoop.yarn.server.webapp.ContainerBlock: Failed to read the container container_1531994217928_0003_01_1099511627773.

Container report failing for Distributed Scheduler containers. Currently all the container are fetched from central RM so need to find alternative for the same.

        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.yarn.exceptions.ContainerNotFoundException: Container with id 'container_1531994217928_0003_01_1099511627773' doesn't exist in RM.
        at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getContainerReport(ClientRMService.java:499)
        at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMContainerBlock.getContainerReport(RMContainerBlock.java:44)
        at org.apache.hadoop.yarn.server.webapp.ContainerBlock$1.run(ContainerBlock.java:82)
        at org.apache.hadoop.yarn.server.webapp.ContainerBlock$1.run(ContainerBlock.java:79)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1688)
        ... 70 more