[YARN-9898] Dependency netty-all-4.1.27.Final doesn't support ARM platform

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0, 3.4.0
• Fix Version/s: 3.3.0, 3.4.0
• Component/s: buid
• Target Version/s: 3.3.0, 3.4.0
• Hadoop Flags: Reviewed
• Assignee: liusheng
• Reporter: liusheng
• Created: 14/Oct/19 09:23
• Updated: 11/Feb/24 12:38
• Resolved: 13/May/20 19:21

Description

Hadoop dependent the Netty package, but the netty-all-4.1.27.Final of io.netty maven repo, cannot support ARM platform. 

When run the test TestCsiClient.testIdentityService on ARM server, it will raise error like following:

Caused by: java.io.FileNotFoundException: META-INF/native/libnetty_transport_native_epoll_aarch_64.so
        at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:161)
        ... 45 more
        Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_aarch_64 in java.library.path
                at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
                at java.lang.Runtime.loadLibrary0(Runtime.java:870)
                at java.lang.System.loadLibrary(System.java:1122)
                at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
                at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243)
                at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124)
                ... 45 more
                Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_aarch_64 in java.library.path
                        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
                        at java.lang.Runtime.loadLibrary0(Runtime.java:870)
                        at java.lang.System.loadLibrary(System.java:1122)
                        at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
                        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
                        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                        at java.lang.reflect.Method.invoke(Method.java:498)
                        at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263)
                        at java.security.AccessController.doPrivileged(Native Method)
                        at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255)
                        at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233)
                        ... 46 more

 

Issue Links

• Blocked: HDFS-15349 Adapt the netty4 ARM support switch(YARN-9898)
• incorporates: HDFS-15349 Adapt the netty4 ARM support switch(YARN-9898)
• is related to: HADOOP-16723 [Umbrella] Support ARM/aarch64