Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
2.1.0-beta, 2.0.5-alpha
-
None
-
None
-
Reviewed
Description
Shuffle#MergeManager only accepts org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce-side Combiner is not used when using the new API, and just ignored. By supporting it and using the feature from ReduceTask, Reduce-side combiner can be enabled with new API. Please see MAPREDUCE-5221 for more detail.
Attachments
Attachments
Issue Links
- blocks
-
MAPREDUCE-5295 ShuffleConsumerPlugin.Context should remove unused combiner-related methods and fields
- Resolved
-
MAPREDUCE-5221 Reduce side Combiner is not used when using the new API
- In Progress