[BEAM-1000] Add non blocking cancel() and waitUntilFinish() for Spark batch application

• Type: Sub-task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Component/s: runner-spark
• Assignee: Stas Levin
• Reporter: Kobi Salant
• Created: 17/Nov/16 12:49
• Updated: 16/May/20 13:36
• Resolved: 05/Dec/16 11:27

Description

Spark batch submit by nature is blocking.

To enable cancel and waitForFinish we will need to run it in a different thread/future and return a context which communicates with it.

Issue Links

• links to: GitHub Pull Request #1466