[SPARK-4350] aggregate doesn't make copies of zeroValue in local mode

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Not A Problem
• Affects Version/s: 1.0.2, 1.1.0, 1.2.0
• Component/s: Spark Core
• Target Version/s: 1.0.3, 1.1.1, 1.2.0
• Assignee: Unassigned
• Reporter: Xiangrui Meng
• Created: 11/Nov/14 22:29
• Updated: 12/Nov/14 03:18
• Resolved: 12/Nov/14 03:18

Description

RDD.aggregate makes a copy of zeroValue to collect the task result. However, it doesn't make copies of zeroValue for each partition. In local mode, this causes race conditions.