[FLINK-16705] LocalExecutor tears down MiniCluster before client can retrieve JobResult

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.1, 1.11.0
• Component/s: Client / Job Submission
• Labels: pull-request-available
• Assignee: Maximilian Michels
• Reporter: Maximilian Michels
• Created: 21/Mar/20 13:17
• Updated: 03/Apr/20 11:19
• Resolved: 03/Apr/20 11:19

Description

There is a race condition in LocalExecutor between (a) shutting down the cluster when the job has finished and (b) the client which retrieves the result of the job execution.

This was observed in Beam, running a large test suite with the Flink Runner.

We should make sure the job result retrieval and the cluster shutdown do not interfere.

Issue Links

• causes: BEAM-9631 Flink 1.10 test execution is broken due to premature test cluster shutdown
• links to: GitHub Pull Request #11473