Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
MR provides ability to the user for plugin custom ShuffleConsumerPlugin using mapreduce.job.reduce.shuffle.consumer.plugin.class. When the user is allowed to use this configuration as plugin, user also interest in implementing his own MergeManagerImpl.
But now , user is forced to use MR provided MergeManagerImpl instead of custom MergeManagerImpl when user is using shuffle.consumer.plugin class. There should be well defined API's in MergeManager that can be used for any implementation without much effort to user for custom implementation.
Attachments
Attachments
Issue Links
- is related to
-
MAPREDUCE-4808 Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations
- Closed