[SPARK-2920] TorrentBroadcast does not support broadcast compression

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.0.0, 1.1.0
• Fix Version/s: 1.0.3, 1.1.0
• Target Version/s: 1.0.3, 1.1.0
• Assignee: Guoqiang Li
• Reporter: Joseph Su
• Created: 08/Aug/14 02:44
• Updated: 08/Aug/14 23:58
• Resolved: 08/Aug/14 23:58

Description

TorrentBroadcast always broadcast uncompressed content. The spark option "spark.broadcast.compress" has no effect for TorrentBroadcast.

Issue Links

• relates to: SPARK-2897 org.apache.spark.broadcast.TorrentBroadcast does use the serializer class specified in the spark option "spark.serializer"