Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-11723

Remove KvState related components from NetworkEnvironment

    XMLWordPrintableJSON

    Details

      Description

      The NetworkEnvironment would be refactored into NetworkShuffleService created by ShuffleManager future. So the NetworkEnvironment should only cover shuffle related components to make the preparation.

      Currently KvStateRegistry, KvStateServer, KvStateClientProxy are not related to shuffle process and mainly used to be got in TaskExecutor. So it is reasonable to remove them from NetworkEnvironment.

      And then we could introduce a new KvStateService for wrapping these three components and pass it into TaskManagerService. This new service can also be passed into TaskExecutor, Task for use and avoid spreading in messy.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjwang Zhijiang
                Reporter:
                zjwang Zhijiang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m