[SPARK-2685] Update ExternalAppendOnlyMap to avoid buffer.remove()

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Spark Core
• Target Version/s: 1.1.0
• Assignee: Matei Alexandru Zaharia
• Reporter: Matei Alexandru Zaharia
• Created: 25/Jul/14 06:17
• Updated: 05/Aug/14 07:32
• Resolved: 05/Aug/14 07:32

Description

This shifts the whole right side of the array back, which can be expensive. It would be better to just swap the last element into the position we want to remove at, then decrease the size of the array.

Issue Links

• links to: [Github] Pull Request #1773 (mateiz)