[SPARK-4249] A problem of EdgePartitionBuilder in Graphx

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.0.3, 1.1.1, 1.2.0
• Component/s: GraphX
• Target Version/s: 1.0.3, 1.1.1, 1.2.0
• Assignee: Unassigned
• Reporter: Cookies
• Created: 05/Nov/14 13:00
• Updated: 26/Nov/14 04:20
• Resolved: 06/Nov/14 18:50

Description

https://github.com/apache/spark/blob/master/graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartitionBuilder.scala#L48
in function toEdgePartition, code snippet " index.update(srcIds(0), 0)"
the elements in array srcIds are all not initialized and are all 0. The effect is that if vertex ids don't contain 0, indexSize is equal to (realIndexSize + 1) and 0 is added to the `index`
It seems that all versions have the problem

Issue Links

• duplicates: SPARK-4173 EdgePartitionBuilder uses wrong value for first clustered index
• links to: [Github] Pull Request #3138 (lianhuiwang)