[SPARK-3117] Avoid serialization for TorrentBroadcast blocks

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Spark Core
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 19/Aug/14 02:32
• Updated: 20/Aug/14 05:12
• Resolved: 20/Aug/14 05:12

Description

TorrentBroadcast uses a bunch of wrapper objects and MEMORY_AND_DISK storage level to store the torrent blocks. I don't think those are necessary. We can probably get rid of them completely to store everything in serialized form.