[MAPREDUCE-801] MAPREDUCE framework should issue warning with too many locations for a split

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Hong Tang
• Created: 24/Jul/09 08:20
• Updated: 23/Jul/14 20:23
• Resolved: 23/Jul/14 20:23

Description

Customized input-format may be buggy and report misleading locations through input-split, an example of which is PIG-878. When an input split returns too many locations, it would not only artificially inflate the percentage of data local or rack local maps, but also force scheduler to use more memory and work harder to conduct task assignment.