[BEAM-10075] Allow users to tune the grouping table size in batch dataflow pipelines

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.23.0
• Component/s: runner-dataflow
• Assignee: Steve Niemitz
• Reporter: Steve Niemitz
• Created: 25/May/20 17:54
• Updated: 27/May/20 15:53
• Resolved: 27/May/20 15:53

Description

The dataflow worker hard-codes the grouping table size to 100 MB.  We should allow users to specify this as a pipeline parameter.

Issue Links

• links to: GitHub Pull Request #11811