[YARN-541] getAllocatedContainers() is not returning all the allocated containers

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha
• Fix Version/s: 2.1.0-beta
• Component/s: resourcemanager

Environment

Redhat Linux 64-bit

• Target Version/s: 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Bikas Saha
• Reporter: Krishna Kishore Bonagiri
• Created: 04/Apr/13 13:13
• Updated: 27/Aug/13 22:15
• Resolved: 13/Jul/13 22:54

Description

I am running an application that was written and working well with the hadoop-2.0.0-alpha but when I am running the same against 2.0.3-alpha, the getAllocatedContainers() method called on AMResponse is not returning all the containers allocated sometimes. For example, I request for 10 containers and this method gives me only 9 containers sometimes, and when I looked at the log of Resource Manager, the 10th container is also allocated. It happens only sometimes randomly and works fine all other times. If I send one more request for the remaining container to RM after it failed to give them the first time(and before releasing already acquired ones), it could allocate that container. I am running only one application at a time, but 1000s of them one after another.

My main worry is, even though the RM's log is saying that all 10 requested containers are allocated, the getAllocatedContainers() method is not returning me all of them, it returned only 9 surprisingly. I never saw this kind of issue in the previous version, i.e. hadoop-2.0.0-alpha.

Thanks,
Kishore