P2 Description
BeamRelNode exposes PCollection<BeamRecord> buildBeamPipeline() which builds a pipeline when parsing.
It feels like it should instead implement a PTransform<PCollection<BeamRecord>, PCollection<BeamRecord>> which would receive a prepared PCollection, and apply sub-expressions instead of manually invoking expression evaluation to get the input.
And maybe consider building it lazily.
Attachments
Issue Links
- links to
