[FLINK-11726] Refactor the creation of ResultPartition and InputGate into NetworkEnvironment

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Zhijiang
• Reporter: Zhijiang
• Created: 22/Feb/19 11:03
• Updated: 09/May/19 07:47
• Resolved: 08/May/19 13:29

Description

The ResultPartition and InputGate are created in Task currently. Based on pluggable ShuffleManager, they should be created via ShuffleService.

The NetworkEnvironment would be refactored into NetworkShuffleService future. So we migrate the process of creating ResultPartition and InputGate into current NetworkEnvironment. The BufferPool and metrics setup can also be done after the creation. Then we can remove the process of NetworkEnvironment#registerTask.

Issue Links

• depends upon: FLINK-12203 Refactor ResultPartitionManager to break tie with Task
• depends upon: FLINK-12199 Refactor IOMetrics to not distinguish between local/remote in/out bytes
• depends upon: FLINK-12202 Consider introducing batch metric register in NetworkEnviroment
• depends upon: FLINK-12146 Remove unregister task from NetworkEnvironment to simplify the interface of ShuffleService
• links to: GitHub Pull Request #7822