[HADOOP-960] Incorrect number of map tasks when there are multiple input files

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 0.10.1
• Component/s: documentation
• Assignee: Unassigned
• Reporter: Andrew McNabb
• Created: 30/Jan/07 02:24
• Updated: 16/Jul/11 18:24
• Resolved: 16/Jul/11 18:24

Description

This problem happens with hadoop-streaming and possibly elsewhere. If there are 5 input files, it will create 130 map tasks, even if mapred.map.tasks=128. The number of map tasks is incorrectly set to a multiple of the number of files. (I wrote a much more complete bug report, but Jira lost it when it had an error, so I'm not in the mood to write it all again)