[MAPREDUCE-2454] Allow external sorter plugin for MR

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha, 2.0.2-alpha, 3.0.0-alpha1
• Fix Version/s: 2.0.3-alpha
• Labels: features performance plugin sort
• Release Note: MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task
• Assignee: Mariappan Asokan
• Reporter: Mariappan Asokan
• Created: 26/Apr/11 18:46
• Updated: 12/May/16 18:22
• Resolved: 15/Dec/12 20:49

Description

Define interfaces and some abstract classes in the Hadoop framework to facilitate external sorter plugins both on the Map and Reduce sides.

Issue Links

• is depended upon by: MAPREDUCE-1639 Grouping using hashing instead of sorting
• is related to: MAPREDUCE-4482 Backport MR sort plugin(MAPREDUCE-2454) to Hadoop 1.2
• relates to: MAPREDUCE-4049 plugin for generic shuffle service
• relates to: MAPREDUCE-4039 Sort Avoidance
• relates to: MAPREDUCE-4891 Pluggable merge at reduce side

Sub-Tasks

• Allow MapOutputBuffer to be pluggable: Closed
• Change visibility of classes for pluggable sort changes: Closed
• plugin for generic shuffle service: Closed