Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
3.0.0-alpha1
-
None
-
None
-
None
Description
The current implementation of sort in MapReduce is cooperated by Map side sort and Reduce side merge. MAPREDUCE-2454 provided pluggable sort at the Map side currently and pluggable shuffle at Reduce side, while no pluggable merger provided.
Considering a general need of hash grouping and join, we may need to replace both the Map Sort and Reduce merge with a more light weight hash grouping alorithm. A general pluggable merge would help support this need.
Attachments
Issue Links
- is related to
-
MAPREDUCE-2454 Allow external sorter plugin for MR
- Closed