Issue Details (XML | Word | Printable)

Key: HADOOP-3366
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Arun C Murthy
Reporter: Arun C Murthy
Votes: 0
Watchers: 4
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Shuffle/Merge improvements

Created: 08/May/08 07:14 AM   Updated: 08/Jul/09 04:52 PM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: 0.18.0

Time Tracking:
Not Specified

File Attachments:
  File Name Date Attached Attached By Size
Text File Licensed for inclusion in ASF works 3366.1.patch 2008-05-16 01:15 PM Devaraj Das 9 kB
Text File Licensed for inclusion in ASF works 3366.1.patch 2008-05-16 01:09 PM Devaraj Das 9 kB
Text File Licensed for inclusion in ASF works 3366.reducetask.patch 2008-06-06 02:27 PM Devaraj Das 3 kB
Text File Licensed for inclusion in ASF works HADOOP-3366_0_20080605.patch 2008-06-06 06:59 AM Arun C Murthy 10 kB
Text File Licensed for inclusion in ASF works HADOOP-3366_2_20080606.patch 2008-06-06 11:48 PM Arun C Murthy 16 kB
Text File Licensed for inclusion in ASF works HADOOP-3366_2_20080606.patch 2008-06-06 11:20 PM Arun C Murthy 15 kB
Text File ifile.patch 2008-05-19 11:06 AM Arun C Murthy 9 kB
Issue Links:
dependent
 

Release Note: Improved shuffle so that all fetched map-outputs are kept in-memory before being merged by stalling the shuffle so that the in-memory merge executes and frees up memory for the shuffle.
Resolution Date: 07/Jun/08 12:09 AM


 Description  « Hide
This is intended to be a meta-issue to track various improvements to shuffle/merge in the reducer.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
No work has yet been logged on this issue.

Powered by a free Atlassian JIRA open source license for Apache Software Foundation. Try JIRA - bug tracking software for your team.
Atlassian JIRA the Professional Issue Tracker. (Enterprise Edition, Version: 3.13.2-#335) - Bug/feature request - Atlassian news - Contact Administrators