[HIVE-2037] Merge result file size should honor hive.merge.size.per.task

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Assignee: Ning Zhang
• Reporter: Ning Zhang
• Created: 09/Mar/11 07:12
• Updated: 16/Dec/11 23:56
• Resolved: 09/Mar/11 23:10

Description

The merge job set mapred.min.split.size to the value of hive.merge.size.per.task, which roughly equals to the output file size. However the input split size is also determined by mapred.min.split.size.per.node, mapred.min.split.size.per.rack, and mapred.max.split.size. They should be set the same as hive.merge.size.per.task as well.