[SPARK-3386] Reuse serializer and serializer buffer in shuffle block iterator

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: Shuffle, Spark Core
• Assignee: Josh Rosen
• Reporter: Reynold Xin
• Created: 03/Sep/14 19:51
• Updated: 26/May/15 17:22
• Resolved: 21/Apr/15 23:24

Issue Links

• breaks: SPARK-7766 KryoSerializerInstance reuse is not safe when auto-reset is disabled
• breaks: SPARK-7873 Serializer re-use + Kryo autoReset disabled leads to AraryIndexOutOfBounds exception in sort-shuffle bypassMergeSort path
• relates to: SPARK-5269 BlockManager.dataDeserialize always creates a new serializer instance
• links to: [Github] Pull Request #5606 (JoshRosen)