Issue Details (XML | Word | Printable)

Key: HADOOP-287
Type: Improvement Improvement
Status: Closed Closed
Resolution: Duplicate
Priority: Major Major
Assignee: Chris Douglas
Reporter: Benjamin Reed
Votes: 0
Watchers: 3
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Speed up SequenceFile sort with memory reduction

Created: 08/Jun/06 04:40 AM   Updated: 17/Apr/08 05:26 AM
Return to search
Component/s: io
Affects Version/s: 0.17.0
Fix Version/s: None

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works 287-1.patch 2008-01-30 02:19 AM Chris Douglas 5 kB
Text File Licensed for inclusion in ASF works 287-2.patch 2008-02-03 05:33 AM Chris Douglas 6 kB
Text File Licensed for inclusion in ASF works 287-2.patch 2008-02-03 01:56 AM Chris Douglas 6 kB
Text File Licensed for inclusion in ASF works s.patch 2006-07-27 02:42 PM Benjamin Reed 4 kB
Text File Licensed for inclusion in ASF works zoom-sort.patch 2006-06-09 12:35 AM Benjamin Reed 3 kB
Text File Licensed for inclusion in ASF works zoom-sort.patch 2006-06-08 04:41 AM Benjamin Reed 3 kB
Issue Links:
Blocker
 
Incorporates
 

Resolution Date: 31/Mar/08 10:53 PM


 Description  « Hide
I replaced the merge sort with a quick sort and it yielded approx 30% improvement in sort time. It also reduced the memory requirement for sorting because the sort is done in place.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
No work has yet been logged on this issue.