[BEAM-5308] JobBundleFactory BindException with FlinkRunner and remote cluster

• Type: Task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.8.0
• Component/s: runner-flink
• Labels: portability
• Assignee: Maximilian Michels
• Reporter: Thomas Weise
• Created: 05/Sep/18 12:14
• Updated: 16/May/20 13:55
• Resolved: 06/Sep/18 14:15

Description

Repeated execution of the same job on remote Flink cluster (not embedded in job server) fails with bind exception. There seem to be 2 issues:

• Multiple instances of job bundle factory cannot be created (port conflict)
• Job bundle factory is not released after job completes (and Docker container keeps on running). That's not the case in embedded mode).

Issue Links

• links to: GitHub Pull Request #6335