[SPARK-26604] Register channel for stream request

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 2.3.4, 2.4.1, 3.0.0
• Component/s: Spark Core
• Assignee: L. C. Hsieh
• Reporter: L. C. Hsieh
• Created: 11/Jan/19 15:28
• Updated: 23/Dec/19 18:50
• Resolved: 16/Jan/19 02:59

Description

Now in TransportRequestHandler.processStreamRequest, when a stream request is processed, the stream id is not registered with the current channel in stream manager. It should do that so in case of that the channel gets terminated we can remove associated streams from stream requests too.

Issue Links

• is duplicated by: SPARK-26418 Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService
• links to: GitHub Pull Request #23521
• links to: GitHub Pull Request #24013
• links to: GitHub Pull Request #26988
• links to: GitHub Pull Request #26989