Issue Details (XML | Word | Printable)

Key: HADOOP-3617
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Chris Douglas
Reporter: Chris Douglas
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Writes from map serialization include redundant checks for accounting space

Created: 22/Jun/08 08:27 AM   Updated: 08/Jul/09 04:52 PM
Return to search
Component/s: None
Affects Version/s: 0.17.0
Fix Version/s: 0.19.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works 3617-0.patch 2008-06-22 08:31 AM Chris Douglas 11 kB
Text File Licensed for inclusion in ASF works 3617-1.patch 2008-06-23 10:02 PM Chris Douglas 11 kB
Text File Licensed for inclusion in ASF works 3617-2.patch 2008-06-25 12:17 AM Chris Douglas 13 kB
Text File Licensed for inclusion in ASF works 3617-3.patch 2008-06-25 10:24 PM Chris Douglas 13 kB

Resolution Date: 16/Jul/08 11:56 PM


 Description  « Hide
In BlockingBuffer::write, the collector verifies that there is sufficient space to hold metadata when it returns to MapOutputBuffer::collect. This check is redundant for serialized records that make more than one call to write.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Repository Revision Date User Message
ASF #677470 Wed Jul 16 23:55:47 UTC 2008 acmurthy HADOOP-3617. Removed redundant checks of accounting space in MapTask and makes the spill thread persistent so as to avoid creating a new one for each spill. Contributed by Chris Douglas.
Files Changed
MODIFY /hadoop/core/trunk/CHANGES.txt
MODIFY /hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/MapTask.java