[SPARK-14724] Improve performance of sorting by using radix sort when possible

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Spark Core
• Assignee: Eric Liang
• Reporter: Eric Liang
• Created: 19/Apr/16 03:29
• Updated: 22/Apr/16 11:44
• Resolved: 21/Apr/16 23:49

Description

Spark currently uses TimSort for all in-memory sorts, including sorts done for shuffle. One low-hanging fruit is to use radix sort when possible (e.g. sorting by integer keys).

Issue Links

• links to: [Github] Pull Request #12490 (ericl)