Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1322

Propagate watermark messages

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.14.0
    • 0.14.0
    • None
    • None

    Description

      TaskInstance will aggregate watermark messages based on counting the upstream tasks, and calculate the result watermark based on the following equation:

      InputWatermark = min

      { OutputWatermark(task) for each task in upstream tasks }

      Then it will deliver the water to the task. The task will process the watermark and finally send it again to downstreams based on stream graph topology.

      Attachments

        Issue Links

          Activity

            People

              xinyu Xinyu Liu
              xinyu Xinyu Liu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: