Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7785

DirectRunner: watermarks are updated asynchronously from bundle processing

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.13.0
    • Fix Version/s: Not applicable
    • Component/s: runner-direct
    • Labels:
      None

      Description

      Watermarks are updated in QuiescenceDriver (by calling fireTimers, which calls forceRefresh()) on WatermarkManager. This results in creating timer bundles, that are then processed asynchronously as DirectTransformExecutor. Because of that, watermarks (input watermarks mostly) might be updated while bundle is being processed. That violates assumption, that bundle processing should be atomical (with identical external conditions during processing of whole bundle).

        Attachments

          Activity

            People

            • Assignee:
              janl Jan Lukavsk√Ĺ
              Reporter:
              janl Jan Lukavsk√Ĺ
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 5h 50m
                5h 50m