Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-11723

Remove KvState related components from NetworkEnvironment

    XMLWordPrintableJSON

Details

    Description

      The NetworkEnvironment would be refactored into NetworkShuffleService created by ShuffleManager future. So the NetworkEnvironment should only cover shuffle related components to make the preparation.

      Currently KvStateRegistry, KvStateServer, KvStateClientProxy are not related to shuffle process and mainly used to be got in TaskExecutor. So it is reasonable to remove them from NetworkEnvironment.

      And then we could introduce a new KvStateService for wrapping these three components and pass it into TaskManagerService. This new service can also be passed into TaskExecutor, Task for use and avoid spreading in messy.

      Attachments

        Issue Links

          Activity

            People

              zjwang Zhijiang
              zjwang Zhijiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m