[BEAM-13024] [Go SDK] Export flags to PipelineOptions on non-dataflow runners.

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Implemented
• Fix Version/s: 2.37.0
• Component/s: sdk-go
• Assignee: Danny McCormick
• Reporter: Robert Burke
• Created: 08/Oct/21 22:05
• Updated: 04/Feb/22 01:35
• Resolved: 04/Feb/22 01:35

Description

Recently the Go SDK dataflow runner code began adding explicitly set flags to the pipeline options. This made them available to worker code at execution time, if queried with `beam.PipelineOptions.Get`. 

The proposal is to generalize this code and make use of it in all runners (including the direct runner).  This would make PipelineOptions a useful concept in the Go SDK.

Flag filtering and adding here:
https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/runners/dataflow/dataflow.go#L281

Once implemented for all runners, it should be possible to test use of this in the integration tests to ensure continued function.

Danny wrote a quick Doc: https://docs.google.com/document/d/1AyO5SDEd_DzyOyrz_TkyDLUv19eLsKI97vKM8I7fQ9o/edit#

Issue Links

• links to: GitHub Pull Request #16719