[SPARK-784] foldByKey does not clone the "zero value" for each key, leading to overwriting

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.2, 0.8.0
• Fix Version/s: 0.7.3, 0.8.0
• Component/s: Spark Core
• Assignee: Matei Alexandru Zaharia
• Reporter: Matei Alexandru Zaharia
• Created: 22/Jun/13 13:37
• Updated: 23/Jun/13 10:27
• Resolved: 23/Jun/13 10:27

Description

This is not a problem with the normal fold() because each task is deserialized separately and gets a separate version of the "zero value". We probably need to do that manually same in foldByKey.