Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7341

Portable Spark: testGlobalCombineWithDefaultsAndTriggers fails

    XMLWordPrintableJSON

    Details

      Description

      PaneInfo for CombineTest.testGlobalCombineWithDefaultsAndTriggers [1] output is incorrect.

      isLast: expected true, is false
      timing: expected UNKNOWN, is EARLY

      No idea yet why this is happening, but commenting out the special GBK translation for non-merging windows [2] seems to fix it.

      [1] https://github.com/apache/beam/blob/8403313ea7d63e49974629136c615e379ea874ce/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/CombineTest.java#L1219-L1242

      [2] https://github.com/apache/beam/blob/e98a3a69295afbfc6984fe92c52125929daf6088/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkBatchPortablePipelineTranslator.java#L165-L170

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ibzib Kyle Weaver
                Reporter:
                ibzib Kyle Weaver
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 50m
                  1h 50m