[SPARK-7251] Perform sequential scan when iterating over entries in BytesToBytesMap

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: Spark Core
• Epic Link: Tungsten Phase 1
• Assignee: Josh Rosen
• Reporter: Josh Rosen
• Created: 29/Apr/15 19:45
• Updated: 20/May/15 23:43
• Resolved: 20/May/15 23:43

Description

In BytesToBytesMap, iterator() iterates in order of set bits in the bitmap, but it would be faster to iterate directly through the data pages, since this will result in less random memory access.

Issue Links

• links to: [Github] Pull Request #5836 (kaka1992)
• links to: [Github] Pull Request #6159 (JoshRosen)