Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12626

Side inputs with Session windows are not populated

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.33.0
    • sdk-py-core
    • None

    Description

      In the following pipeline, side input values are always empty:

      windowed = (
          p
          | beam.Create([('k', 1), ('k', 2), ('k', 20)])
          | beam.MapTuple(
              lambda k, v: beam.transforms.window.TimestampedValue((k, v), v))
          | beam.WindowInto(beam.transforms.window.Sessions(10)))
      
      windowed | beam.Map(lambda k, si: (k, si), beam.pvalue.AsIter(windowed))
      

      The problem does not happen with FixedWindows, and in Java similarly formed pipelines (side input with Sessions windows) are rejected (https://github.com/apache/beam/blob/8463a054c1d7e2b7ee8d11e9569e065cb5e02196/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/windowing/Sessions.java#L97)

      Attachments

        Issue Links

          Activity

            People

              altay Ahmet Altay
              altay Ahmet Altay
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m