Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9825

Transforms for Intersect, IntersectAll, Except, ExceptAll, Union, UnionAll

    XMLWordPrintableJSON

    Details

      Description

      I'd like to propose following new high-level transforms.

      • Intersect
        Compute the intersection between elements of two PCollection.
        Given leftCollection and rightCollection, this transform returns a collection containing elements that common to both leftCollection and rightCollection
      • Except
        Compute the difference between elements of two PCollection.
        Given leftCollection and rightCollection, this transform returns a collection containing elements that are in leftCollection but not in rightCollection
      • Union
        Find the elements that are either of two PCollection.

      Implement IntersetAll, ExceptAll and UnionAll variants of transforms.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                darshanjani Darshan Jani
                Reporter:
                darshanjani Darshan Jani
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 96h
                  96h
                  Remaining:
                  Time Spent - 11.5h Remaining Estimate - 84.5h
                  84.5h
                  Logged:
                  Time Spent - 11.5h Remaining Estimate - 84.5h
                  11.5h