[SPARK-16862] Configurable buffer size in `UnsafeSorterSpillReader`

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.1.0
• Component/s: Spark Core
• Assignee: Tejas Patil
• Reporter: Tejas Patil
• Created: 03/Aug/16 00:59
• Updated: 24/Aug/16 01:47
• Resolved: 24/Aug/16 01:47

Description

`BufferedInputStream` used in `UnsafeSorterSpillReader` uses the default 8k buffer to read data off disk. This could be made configurable to improve on disk reads.

https://github.com/apache/spark/blob/master/core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java#L53

Issue Links

• links to: [Github] Pull Request #14475 (tejasapatil)
• links to: [Github] Pull Request #14726 (tejasapatil)