Hadoop Common
  1. Hadoop Common
  2. HADOOP-6801

io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java

    Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Following configuration keys in CommonConfigurationKeysPublic.java (former CommonConfigurationKeys.java):

      public static final String IO_SORT_MB_KEY = "io.sort.mb";
      public static final String IO_SORT_FACTOR_KEY = "io.sort.factor";

      are partially moved:

      • they were renamed to mapreduce.task.io.sort.mb and mapreduce.task.io.sort.factor respectively
      • they were moved to mapreduce project, documented in mapred-default.xml

      However:

      • they are still listed in CommonConfigurationKeysPublic.java as quoted above
      • strings "io.sort.mb" and "io.sort.factor" are used in SequenceFile.java in Hadoop Common project

      Not sure what the solution is, these constants should probably be removed from CommonConfigurationKeysPublic.java but I am not sure what's the best solution for SequenceFile.java.

      1. HADOOP-6801.05.patch
        8 kB
        Allen Wittenauer
      2. HADOOP-6801.r5.diff
        8 kB
        Harsh J
      3. HADOOP-6801.r4.diff
        8 kB
        Harsh J
      4. HADOOP-6801.r3.diff
        8 kB
        Harsh J
      5. HADOOP-6801.r2.diff
        4 kB
        Harsh J
      6. HADOOP-6801.r1.diff
        3 kB
        Harsh J

        Issue Links

          Activity

          Erik Steffl created issue -
          Nigel Daley made changes -
          Field Original Value New Value
          Fix Version/s 0.22.0 [ 12314296 ]
          Harsh J made changes -
          Assignee Harsh J [ qwertymaniac ]
          Harsh J made changes -
          Link This issue incorporates MAPREDUCE-2622 [ MAPREDUCE-2622 ]
          Harsh J made changes -
          Attachment HADOOP-6801.r1.diff [ 12483816 ]
          Harsh J made changes -
          Link This issue incorporates MAPREDUCE-2703 [ MAPREDUCE-2703 ]
          Harsh J made changes -
          Attachment HADOOP-6801.r2.diff [ 12507832 ]
          Harsh J made changes -
          Target Version/s 0.24.0 [ 12317652 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Attachment HADOOP-6801.r3.diff [ 12526628 ]
          Harsh J made changes -
          Attachment HADOOP-6801.r4.diff [ 12526631 ]
          Harsh J made changes -
          Attachment HADOOP-6801.r5.diff [ 12526633 ]
          Harsh J made changes -
          Target Version/s 0.24.0 [ 12317652 ] 3.0.0 [ 12320357 ]
          Allen Wittenauer made changes -
          Attachment HADOOP-6801.05.patch [ 12729958 ]
          Allen Wittenauer made changes -
          Labels BB2015-05-TBR
          Ray Chiang made changes -
          Labels BB2015-05-TBR
          Ray Chiang made changes -
          Labels BB2015-05-RFC
          Chris Nauroth made changes -
          Labels BB2015-05-RFC

            People

            • Assignee:
              Harsh J
              Reporter:
              Erik Steffl
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development