Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.10.1
-
None
-
None
Description
The Reduce's shuffle and initial merge is done in the TaskTracker's JVM. It would be better to have it run in the Task's child JVM. The advantages are:
1. The class path and environment would be set up correctly.
2. User code doesn't need to be loaded into the TaskTracker.
3. Lower memory usage and contention in the TaskTracker.
Attachments
Attachments
Issue Links
- relates to
-
HADOOP-964 ClassNotFoundException in ReduceTaskRunner
- Closed