[BEAM-7830] SparkPipelineResult waitUntilFinish duration not consistent with PipelineResult

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: 2.13.0
• Fix Version/s: 2.15.0
• Component/s: runner-spark
• Assignee: Filipe Regadas
• Reporter: Filipe Regadas
• Created: 26/Jul/19 15:47
• Updated: 16/May/20 13:24
• Resolved: 29/Jul/19 13:39

Description

`DataflowPipelineJob` default duration on `waitUntilFinish` is `Duration.millis(-1)` which is inline with `PipelineResult#waitUntilFinish` doc <= 1ms results in infinite wait. 

However, `SparkPipelineResult#waitUntilFinish` uses `Duration.millis(Long.MAX_VALUE)` hence not being consistent with `PipelineResult#waitUntilFinish`

Issue Links

• links to: GitHub Pull Request #9170