Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-12146

Remove unregister task from NetworkEnvironment to simplify the interface of ShuffleService

    XMLWordPrintableJSON

    Details

      Description

      The current NetworkEnvironment would be the default ShuffleService implementation in task manager. In order to make the interface simple, we try to avoid more interactive with NetworkEnvironment.

      NetworkEnvironment#unregisterTask is used for closing partition/gate and releasing partition from ResultPartitionManager. partition/gate close could be done in task which already maintains the arrays of them. Further we could release partition from ResultPartitionManager inside ResultPartition via introducing ResultPartition#close(Throwable). To do so, the NetworkEnvironment#unregisterTask could be totally replaced to remove.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjwang Zhijiang
                Reporter:
                zjwang Zhijiang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m