[BEAM-8850] Flink: Batch translation context respects provided PTransform during Input / Output lookups.

• Type: Sub-task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.23.0
• Component/s: runner-flink
• Labels: stale-assigned
• Assignee: David Morávek
• Reporter: David Morávek
• Created: 29/Nov/19 07:38
• Updated: 02/Jun/20 14:55
• Resolved: 02/Jun/20 14:55

Description

Currently batch translation context uses `currentTransform` for input / ouput lookups, even though we provide a `PTransform` we want to perform lookup for as a parameter.

We need to introduce a new PipelineVisitor, that would be initialized prior translation and build an in-memory PTransform / AppliedPTransform lookup table, that can be used by translation context.

Issue Links

• is required by: BEAM-8848 Flink: Memory efficient GBK implementation for batch runner
• links to: GitHub Pull Request #11857