[SPARK-10704] Rename HashShufflereader to BlockStoreShuffleReader

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: Shuffle, Spark Core
• Assignee: Josh Rosen
• Reporter: Josh Rosen
• Created: 18/Sep/15 19:00
• Updated: 17/May/20 18:30
• Resolved: 22/Sep/15 18:50

Description

The current shuffle code has an interface named ShuffleReader with only one implementation, HashShuffleReader. This naming is confusing, since the same read path code is used for both sort- and hash-based shuffle. We should consolidate these classes. We should rename HashShuffleReader.

-In addition, there are aspects of ShuffleManager.getReader()'s API which don't make a lot of sense: it exposes the ability to request a contiguous range of shuffle partitions, but this feature isn't supported by any ShuffleReader implementations and isn't used anywhere in the existing code. We should clean this up, too.-

Issue Links

• links to: [Github] Pull Request #8825 (JoshRosen)