[SPARK-826] fold(), reduce(), collect() always attempt to use java serialization

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.2
• Fix Version/s: 0.8.0
• Assignee: Dmitriy Lyubimov
• Reporter: Dmitriy Lyubimov
• Created: 22/Jul/13 13:16
• Updated: 18/Sep/13 11:14
• Resolved: 11/Aug/13 20:42

Description

For objects that support other than java serialization, a whole range of methods communicating task result to the front end fail because task result is always using closure serializer and ignoring proper object serializer.

Relevant discussion: https://groups.google.com/forum/#!searchin/spark-users/parallelize$20kryo/spark-users/0NYbRS_ujkk/mfPueHz75fkJ