[SAMZA-124] Provide AM based antiaffinity to avoid clumping of containers

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.6.0
• Component/s: container
• Assignee: Chris Riccomini
• Reporter: Jakob Homan
• Created: 08/Jan/14 19:18
• Updated: 23/May/14 19:40

Description

We're seeing YARN scheduling lots of containers on the same box causing NIC saturation and cluster degradation. Pending SAMZA-74 (and its dependency, YARN-1042), it would be good to have some basic anti-affinity support at the AM level. We can be selective about what nodes we request and accept from the RM, hopefully spreading the containers around the cluster more evenly.

Issue Links

• is related to: SAMZA-74 Use anti-affinity in YARN container requests