[BEAM-9218] Template staging broken on Beam 2.18.0

• Type: Bug
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.18.0
• Fix Version/s: 2.20.0
• Component/s: runner-dataflow
• Assignee: Robert Bradshaw
• Reporter: Michael Charkin
• Created: 29/Jan/20 19:52
• Updated: 13/Apr/23 11:00
• Resolved: 31/Jan/20 19:02

Description

beam 2.18.0 can not stage cloud Dataflow templates

 

Looks like it is trying to access the RuntimeValueProvider during staging causing 'not accessible'

 

Repo with code to reproduce the issue: https://github.com/firemuzzy/dataflow-templates-bug

 

With the help of stack overflow narrowed the issue to the latest beam release and not python versions

https://stackoverflow.com/questions/59940069/how-do-you-create-a-google-cloud-dataflow-template-with-python-3?noredirect=1#59940069