Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
A cache-friendly sort algorithm that can be used eventually for:
- sort-merge join
- shuffle
See the old alpha sort paper: http://research.microsoft.com/pubs/68249/alphasort.doc
Note that state-of-the-art for sorting has improved quite a bit, but we can easily optimize the sorting algorithm itself later.
Attachments
Issue Links
- blocks
-
SPARK-7079 Cache-aware external sort
-
- Resolved
-
- is blocked by
-
SPARK-8932 Support copy in UnsafeRow as long as ObjectPool is not used
-
- Resolved
-
- links to