[SPARK-9457] Sorting improvements

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Epic Link: Tungsten Phase 1
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 30/Jul/15 00:42
• Updated: 04/Aug/15 00:57
• Resolved: 04/Aug/15 00:57

Description

An umbrella ticket to improve sorting in Tungsten.

Sub-Tasks

• Fix array out of bounds and use-after-free bugs in UnsafeExternalSorter: Resolved
• Cache-aware external sort: Resolved
• Cache-aware binary processing in-memory sort: Resolved
• Avoid object allocation in prefix generation: Resolved
• avoid copy for UTF8String during unsafe sorting: Resolved
• Avoid byte array allocation in StringPrefixComparator: Resolved
• TungstenSort should not do safe -> unsafe conversion itself: Resolved
• UTF8String.getPrefix only works in little-endian order: Resolved
• Support prefix generation for date / timestamp data type: Resolved
• Improve sort on Decimal: Resolved