[HADOOP-13866] Upgrade netty-all to 4.1.1.Final

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0-alpha1
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 05/Dec/16 19:51
• Updated: 12/Jun/23 21:44
• Resolved: 17/Oct/17 16:46

Description

netty-all 4.1.1.Final is stable release which we should upgrade to.

See bottom of HADOOP-12927 for related discussion.

This issue was discovered since hbase 2.0 uses 4.1.1.Final of netty.

When launching mapreduce job from hbase, /grid/0/hadoop/yarn/local/ usercache/hbase/appcache/application_1479850535804_0008/container_e01_1479850535804_0008_01_000005/mr-framework/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar (from hdfs) is ahead of 4.1.1.Final jar (from hbase) on the classpath.
Resulting in the following exception:

2016-12-01 20:17:26,678 WARN [Default-IPC-NioEventLoopGroup-1-1] io.netty.util.concurrent.DefaultPromise: An exception was thrown by org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete()
java.lang.NoSuchMethodError: io.netty.buffer.ByteBuf.retainedDuplicate()Lio/netty/buffer/ByteBuf;
        at org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete(NettyRpcConnection.java:272)
        at org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete(NettyRpcConnection.java:262)
        at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680)
        at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603)
        at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563)
        at io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:406)

Issue Links

• duplicates: HADOOP-12854 Move to netty 4.1.x release
• duplicates: HADOOP-11219 [Umbrella] Upgrade to netty 4
• incorporates: HDFS-11214 Upgrade netty-all to 4.1.1.Final
• is depended upon by: HADOOP-9991 Fix up Hadoop POMs, roll up JARs to latest versions
• is duplicated by: HADOOP-12927 Update netty-all to 4.0.34.Final
• is related to: HDFS-11376 Revert HDFS-8377 Support HTTP/2 in datanode
• is related to: HDFS-11498 Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0
• is related to: HADOOP-11656 Classpath isolation for downstream clients
• relates to: HDFS-8377 Support HTTP/2 in datanode
• relates to: HADOOP-14043 Shade netty 4 dependency in hadoop-hdfs