[BEAM-1052] UnboundedSource splitId uniqueness breaks if more than one source is used.

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Component/s: runner-spark
• Assignee: Aviem Zur
• Reporter: Amit Sela
• Created: 27/Nov/16 14:27
• Updated: 16/May/20 13:57
• Resolved: 29/Nov/16 10:50

Description

We use a "running-id" to identify source splits, but we reiterate for each source evaluated.
Spark already assigns a unique id per InputDStream, it would be unique enough if we replace MicrobatchSource hash code with one containing both the running-id and the InputDStream id.

Issue Links

• links to: GitHub Pull Request #1450