[SPARK-20074] Make buffer size in unsafe external sorter configurable

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.0.1
• Component/s: Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Sital Kedia
• Created: 23/Mar/17 19:01
• Updated: 08/Oct/19 05:43
• Resolved: 08/Oct/19 05:43

Description

Currently, it is hardcoded to 32kb, see - https://github.com/sitalkedia/spark/blob/master/core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java#L123