[SPARK-18375] Upgrade netty to 4.0.42.Final

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.2, 2.0.1
• Fix Version/s: 2.1.0
• Component/s: Build, Spark Core
• Assignee: Guoqiang Li
• Reporter: Guoqiang Li
• Created: 09/Nov/16 02:08
• Updated: 07/Dec/16 08:26
• Resolved: 12/Nov/16 09:49

Description

One of the important changes for 4.0.42.Final is "Support any FileRegion implementation when using epoll transport #5825".

In 4.0.42.Final,MessageWithHeader can work properly when spark.(shufflem, rpc).io.mode is set to epoll

Issue Links

• is duplicated by: SPARK-18756 Memory leak in Spark streaming
• links to: [Github] Pull Request #15830 (witgo)