Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3607

Port missing new API mapreduce lib classes to 1.x

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.0.1
    • Component/s: client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      There are a number of classes under mapreduce.lib that are not present in the 1.x series. Including these would help users and downstream projects using the new MapReduce API migrate to later versions of Hadoop in the future.

      A few examples of where this would help:

      • Sqoop uses mapreduce.lib.db.DBWritable and mapreduce.lib.input.CombineFileInputFormat (SQOOP-384).
      • Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822).
      • HBase has a backport of mapreduce.lib.partition.InputSampler and TotalOrderPartitioner (in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - it would be better if it used the ones in Hadoop.
      1. MAPREDUCE-3607.patch
        551 kB
        Tom White
      2. MAPREDUCE-3607.patch
        550 kB
        Tom White
      3. MAPREDUCE-3607.patch
        315 kB
        Tom White

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Tom White
              Reporter:
              Tom White
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development