[SAMZA-1484] Host affinity improvements for YARN

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.15.0
• Assignee: Jagadish
• Reporter: Jagadish
• Created: 08/Nov/17 01:05
• Updated: 16/Jun/18 00:07

Description

https://docs.google.com/document/u/1/d/1oeNKDnG4JIGT2846us-jpnGW_RUjMjPIKDeEUlE_-jg/edit#heading=h.ri95ihqjudod

Sub-Tasks

• Implement async NodeManager interactions: Closed
• Race condition in ClusterResourceManager: Closed
• Prioritize preferred host requests over ANY-HOST requests: Closed
• Improve host-aware allocation to account for strict locality: Resolved
• Add metrics to measure the effectiveness of host affinity: Closed
• Host affinity improvements - Improve matching of hosts to allocated resources: Resolved