[MAPREDUCE-1044] Ability to automatically move machines from one MR compute cluster to another

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Tags: fb
• Assignee: Dmytro Molkov
• Reporter: Dhruba Borthakur
• Created: 27/Sep/09 21:45
• Updated: 23/Jul/14 21:21
• Resolved: 23/Jul/14 21:21

Description

We have multiple map-reduce clusters that provide different service and support levels for their users. We have seen that utilization of hardware resources are not optimized if we have a static partition of existing hardware resources into these separate MR clusters. It would be nice to have a automatic way to move nodes from one MR cluster to another based on load characteristics and configured policies. This JIRA will discuss some of the ideas and possible implementations of those ideas.

Issue Links

• is blocked by: MAPREDUCE-892 command line tool to list all tasktrackers and their status