[MAPREDUCE-6793] io.sort.factor code default and mapred-default.xml values inconsistent

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 2.6.5, 3.0.0-alpha1
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: task
• Labels: noob
• Hadoop Flags: Reviewed
• Assignee: Prabhu Joseph
• Reporter: Gera Shegalov
• Created: 14/Oct/16 22:02
• Updated: 23/Oct/19 16:14
• Resolved: 21/Nov/16 16:43

Description

The actual default value in mapred-default.xml:

<property>
  <name>mapreduce.task.io.sort.factor</name>
  <value>10</value>
  <description>The number of streams to merge at once while sorting
  files.  This determines the number of open file handles.</description>
</property>

However, MapTask and MergeManagerImpl, are coded with:

       
 int mergeFactor = job.getInt(JobContext.IO_SORT_FACTOR, 100);