[BEAM-7797] DataflowRunner's upload_graph feature doesn't reduce template file size

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.15.0
• Component/s: runner-dataflow
• Assignee: Yunqing Zhou
• Reporter: Yunqing Zhou
• Created: 22/Jul/19 19:43
• Updated: 16/May/20 13:24
• Resolved: 31/Jul/19 16:23

Description

Dataflow Runner has a feature to save job graph separately, reducing the size of the request to Dataflow API.

Since templates are simply dumps of requests to the API, sizes of template files should be reduced as well.

 

However, the logic to remove parts from the request happened after template file generation.

 

Issue Links

• links to: GitHub Pull Request #9128