Details

      Description

      We need to add a new RPC to the JobMaster such that the current watermark for every source sub-task can be reported and the current global minimum/maximum watermark can be retrieved so that each source can adjust their partition read rates in an attempt to keep sources roughly aligned in event time.

       

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jgrier Jamie Grier
                Reporter:
                jgrier Jamie Grier
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Time Spent - 50m Remaining Estimate - 23h 10m
                  23h 10m
                  Logged:
                  Time Spent - 50m Remaining Estimate - 23h 10m
                  50m