[BEAM-9825] Transforms for Intersect, IntersectAll, Except, ExceptAll, Union, UnionAll

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: dsl-sql, sdk-java-core
• Labels: Done
• Assignee: Darshan Jani
• Reporter: Darshan Jani
• Created: 27/Apr/20 07:25
• Updated: 06/Oct/20 21:52
• Resolved: 10/Jun/20 17:44

Description

I'd like to propose following new high-level transforms.

• Intersect
  Compute the intersection between elements of two PCollection.
  Given leftCollection and rightCollection, this transform returns a collection containing elements that common to both leftCollection and rightCollection

• Except
  Compute the difference between elements of two PCollection.
  Given leftCollection and rightCollection, this transform returns a collection containing elements that are in leftCollection but not in rightCollection

• Union
  Find the elements that are either of two PCollection.

Implement IntersetAll, ExceptAll and UnionAll variants of transforms.

Issue Links

• Dependent: BEAM-9992 Migrate BeamSQL's SET operators to Sets transforms
• links to: GitHub Pull Request #11610