[BEAM-4067] Java: FlinkPortableTestRunner: runs portably via self-started local Flink

• Type: New Feature
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.7.0
• Component/s: runner-flink
• Assignee: Ankur Goenka
• Reporter: Ben Sidhom
• Created: 13/Apr/18 17:10
• Updated: 16/May/20 13:18
• Resolved: 01/Aug/18 22:03

Description

The portable Flink runner cannot be tested through the normal mechanisms used for ValidatesRunner tests because it requires a job server to be constructed out of band and for pipelines to be run through it. We should implement a shim that acts as a standard Java SDK Runner that spins up the necessary server (possibly in-process) and runs against it.

Issue Links

• depends upon: BEAM-4776 Java PortableRunner should support metrics
• depends upon: BEAM-4071 Java: PortableRunner - p.run() via given JobService
• depends upon: BEAM-4130 Portable Flink runner JobService entry point in a Docker container
• is depended upon by: BEAM-4176 Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes
• is depended upon by: BEAM-2889 Flink runs portable pipelines