Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-11726

Refactor the creation of ResultPartition and InputGate into NetworkEnvironment

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      The ResultPartition and InputGate are created in Task currently. Based on pluggable ShuffleManager, they should be created via ShuffleService.

      The NetworkEnvironment would be refactored into NetworkShuffleService future. So we migrate the process of creating ResultPartition and InputGate into current NetworkEnvironment. The BufferPool and metrics setup can also be done after the creation. Then we can remove the process of NetworkEnvironment#registerTask.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zjwang Zhijiang
            zjwang Zhijiang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack

                  Issue deployment