[HADOOP-8495] Update Netty to avoid leaking file descriptors during shuffle

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 0.23.3, 2.0.2-alpha
• Component/s: build
• Target Version/s: 0.23.3
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 08/Jun/12 19:10
• Updated: 12/Jun/23 21:39
• Resolved: 18/Jun/12 14:47

Description

Netty 3.2.3.Final has a known bug where writes to a closed channel do not have their futures invoked. See Netty-374. This can lead to file descriptor leaks during shuffle as noted in MAPREDUCE-4298.

Issue Links

• is duplicated by: MAPREDUCE-4298 NodeManager crashed after running out of file descriptors