[SPARK-9104] expose network layer memory usage

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Component/s: Spark Core
• Assignee: Saisai Shao
• Reporter: Zhang, Liye
• Created: 16/Jul/15 14:33
• Updated: 14/Nov/17 02:15
• Resolved: 06/Sep/17 04:29

Description

The default network transportation is netty, and when transfering blocks for shuffle, the network layer will consume a decent size of memory, we shall collect the memory usage of this part and expose it.

Issue Links

• links to: [Github] Pull Request #7753 (liyezhang556520)
• links to: [Github] Pull Request #18935 (jerryshao)