[SPARK-22459] EdgeDirection "Either" Does Not Considerate Real "Either" Direction

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.1.1, 2.1.2, 2.2.0
• Component/s: GraphX
• Labels: bulk-closed

Environment

Windows 7. Yarn cluster / client mode. Tested with 2.2.0, 2.1.1 and 2.1.2 spark versions.

• Flags: Important
• Assignee: Unassigned
• Reporter: Tom
• Created: 06/Nov/17 19:26
• Updated: 21/May/19 04:14
• Resolved: 21/May/19 04:14

Description

When running functions involving EdgeDirection, the EdgeDirection.Either type does not truly perform the actual specified direction (either).
For instance, when using Pregel API with a simple graph as shown:

With EdgeDirection.Either you would guess that vertex #3 will send a message (when activated) to vertices 1, 2, and 4, but in reality it does not.
This might be bypassed, but in an expansive and ineffective way.
Tested with 2.2.0, 2.1.1 and 2.1.2 spark versions.