[TEZ-4005] Add Host-Source input penalties to Unordered Shuffle

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.1
• Assignee: Unassigned
• Reporter: Kuhu Shukla
• Created: 10/Oct/18 19:29
• Updated: 10/Oct/18 19:29

Description

Ordered shuffle has a mechanism to penalize hosts and try exponential waits for retrying. Unordered case is missing this feature. Would be really useful to add this and make shuffle policies consistent.