[BEAM-2863] Add support for Side Inputs over the Fn API

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: beam-model
• Labels: portability
• Assignee: Luke Cwik
• Reporter: Luke Cwik
• Created: 07/Sep/17 20:01
• Updated: 16/May/20 13:32
• Resolved: 21/Sep/18 16:53

Description

See:

• https://s.apache.org/beam-side-inputs-1-pager
• http://s.apache.org/beam-fn-api-state-api

Issue Links

• is depended upon by: BEAM-2940 Portability milestone: mobile gaming runs everywhere
• links to: GitHub Pull Request #4368
• links to: GitHub Pull Request #4377
• links to: GitHub Pull Request #4439
• links to: GitHub Pull Request #4440

Sub-Tasks

• Java SDK support for portable side input: Resolved
• Python SDK support for portable side input: Resolved
• Dataflow support for portable side input: Resolved
• Flink support for portable side input: Resolved
• Apex support for portable side input: Resolved
• Spark support for portable side input: Resolved
• Gearpump support for portable side input: Resolved
• Tez support for portable side input: Resolved
• MapReduce support for portable side input: Resolved
• JStorm support for portable side input: Resolved
• Go SDK support for portable side input: Resolved
• Support remapping the main input window to side input window inside the Java SDK harness: Resolved
• Make the windowing strategy available within the PCollectionView/CollectionToSingleton that is sent to Dataflow: Resolved
• Have Dataflow use the windowing strategy within the PCollectionToView/CollectionToSingleton expansion: Resolved
• Have Dataflow map main input windows to side input windows: Resolved
• Side inputs do not work on Dataflow: Resolved