[BEAM-3971] Pipeline translation utilities should not use SDK construction classes

• Type: Improvement
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: runner-core
• Assignee: Unassigned
• Reporter: Ben Sidhom
• Created: 29/Mar/18 20:46
• Updated: 13/Jan/22 21:52
• Resolved: 15/May/21 17:58

Description

In general, portable runners will require access to pipeline information not available in rehydrated pipelines while constructing physical plans. Translation utilities should operate directly on protos or on thin, information-preserving wrappers.

The pipeline fusion utilities already operate on protos directly and can be used as an example of how this could be done.

Issue Links

• relates to: BEAM-3972 Flink runner translates batch pipelines directly by proto
• links to: GitHub Pull Request #5833