[MAPREDUCE-4808] Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.0.3-alpha
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Now that Shuffle is pluggable (~~MAPREDUCE-4049~~), it would be convenient for alternate implementations to be able to reuse portions of the default implementation.

This would come with the strong caveat that these classes are LimitedPrivate and Unstable.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

mapreduce-4808.patch
25/Nov/12 05:03
39 kB
Mariappan Asokan
COMBO-mapreduce-4809-4812-4808.patch
26/Nov/12 19:38
84 kB
Mariappan Asokan
mapreduce-4808.patch
17/Dec/12 23:28
67 kB
Mariappan Asokan
mapreduce-4808.patch
18/Dec/12 17:49
67 kB
Mariappan Asokan
MergeManagerPlugin.pdf
21/Dec/12 03:06
47 kB
Mariappan Asokan
mapreduce-4808.patch
21/Dec/12 03:45
71 kB
Mariappan Asokan
mapreduce-4808.patch
23/Dec/12 22:41
78 kB
Mariappan Asokan
mapreduce-4808.patch
15/Jan/13 21:05
61 kB
Mariappan Asokan
mapreduce-4808.patch
15/Jan/13 21:55
62 kB
Mariappan Asokan
MR-4808.patch
17/Jan/13 23:10
51 kB
Alejandro Abdelnur
mapreduce-4808.patch
18/Jan/13 20:19
45 kB
Mariappan Asokan
M4808-0.patch
18/Jan/13 23:28
103 kB
Christopher Douglas
M4808-1.patch
19/Jan/13 01:03
103 kB
Christopher Douglas

Issue Links

relates to

MAPREDUCE-6332 Provide facility to users for writting custom MergeManager implementation when custom shuffleconsumerPluggin is used

Open

Activity

People

Assignee:: Mariappan Asokan

Reporter:: Arun Murthy

Votes:: 0 Vote for this issue

Watchers:: 19 Start watching this issue

Dates

Created:: 19/Nov/12 19:28

Updated:: 27/Apr/15 23:45

Resolved:: 22/Jan/13 14:12