[MAPREDUCE-5654] blacklist is not propagated from AM to RM

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: applicationmaster
• Assignee: Unassigned
• Reporter: Robert Grandl
• Created: 25/Nov/13 19:29
• Updated: 21/Jul/14 19:04

Description

I was trying to blacklist some nodes. I added a set of hosts as strings into blacklistAdditions list and propagated into RMContainerRequestor#makeRemoteRequest to the RM.

However the blacklist is received empty at RM. I logged the path for blacklist in AM and I found that in ApplicationMasterProtocolPBClientImpl#allocate, this list is lost.

I print request.getResourceBlacklistRequest().getBlacklistAdditions().toString() at the beginning of ApplicationMasterProtocolPBClientImpl#allocate and the blacklisted additions are there.

After AllocateRequestProto requestProto is created based on this request, and I print again requestProto.getBlacklistRequest().getBlacklistAdditionsList().toString(), the blacklist additions is empty now.

I looked even further and log what happened. At some point in yarn-api, I was lost with my logging as that code was regenerated every time I recompiled yarn-api.

Thanks,
robert