[MAPREDUCE-3607] Port missing new API mapreduce lib classes to 1.x

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.0.1
• Component/s: client
• Target Version/s: 1.0.1
• Hadoop Flags: Reviewed
• Assignee: Thomas White
• Reporter: Thomas White
• Created: 29/Dec/11 05:55
• Updated: 02/May/13 02:29
• Resolved: 24/Jan/12 23:31

Description

There are a number of classes under mapreduce.lib that are not present in the 1.x series. Including these would help users and downstream projects using the new MapReduce API migrate to later versions of Hadoop in the future.

A few examples of where this would help:

• Sqoop uses mapreduce.lib.db.DBWritable and mapreduce.lib.input.CombineFileInputFormat (SQOOP-384).
• Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822).
• HBase has a backport of mapreduce.lib.partition.InputSampler and TotalOrderPartitioner (in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - it would be better if it used the ones in Hadoop.

Issue Links

• depends upon: MAPREDUCE-334 Change mapred.lib code to use new api
• is required by: SQOOP-384 Sqoop is incompatible with Hadoop prior to 0.21
• relates to: SQOOP-413 Port files org.apache.hadoop.mapreduce.lib.{db,input}.* from CDH3/Hadoop-0.21 to sqoop