Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21364

piggyback finishedSplitIds in RequestSplitEvent

    XMLWordPrintableJSON

    Details

      Description

      For some split assignment strategy, the enumerator/assigner needs to track the completed splits to advance watermark for event time alignment or rough ordering. Right now, `RequestSplitEvent` for FLIP-27 source doesn't support pass-along of the `finishedSplitIds` info and hence we have to create our own custom source event type for Iceberg source.

      Here is the proposal of add such optional info to `RequestSplitEvent`.

      public RequestSplitEvent(
          @Nullable String hostName, 
          @Nullable Collection<String> finishedSplitIds)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevenz3wu Steven Zhen Wu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: