[FLINK-28013] java.lang.ClassNotFoundException: org.apache.flink.hbase.shaded.io.netty.channel.EventLoopGroup

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: hbase-3.0.0
• Component/s: Connectors / HBase
• Labels: pull-request-available

Environment

Flink: 1.15.0

Hbase: 1.4.9

• Assignee: He Wang
• Reporter: JasonLee
• Created: 12/Jun/22 16:35
• Updated: 01/Sep/23 14:25
• Resolved: 28/Aug/23 12:12

Description

When using the hbase-1.4 version of the connector, the following exception will be reported. It seems that the io.netty related package is lost. I found that the io.netty package is redirected in maven. When I remove the redirection and compile a new one package, found that the task can be submitted normally, and then I tested the hbase-2.2 version of the package, and found that the task can be submitted normally, I compared the maven configuration of 1.4 and 2.2 and it seems that there is not much difference, so I am a little confused , why version 1.4 needs to remove redirection io.netty to run tasks normally

java.lang.RuntimeException: Cannot create connection to HBase.
    at org.apache.flink.connector.hbase.sink.HBaseSinkFunction.open(HBaseSinkFunction.java:153)
    at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:34)
    at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:100)
    at org.apache.flink.table.runtime.operators.sink.SinkOperator.open(SinkOperator.java:58)
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:107)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:700)
    at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:676)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:643)
    at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
    at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:917)
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.apache.flink.hbase.shaded.org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240)
    at org.apache.flink.hbase.shaded.org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218)
    at org.apache.flink.hbase.shaded.org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
    at org.apache.flink.connector.hbase.sink.HBaseSinkFunction.open(HBaseSinkFunction.java:116)
    ... 13 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.GeneratedConstructorAccessor21.newInstance(Unknown Source)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.flink.hbase.shaded.org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238)
    ... 16 more
Caused by: java.lang.NoClassDefFoundError: org/apache/flink/hbase/shaded/io/netty/channel/EventLoopGroup
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:348)
    at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2332)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2297)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2393)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2419)
    at org.apache.flink.hbase.shaded.org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:714)
    ... 20 more
Caused by: java.lang.ClassNotFoundException: org.apache.flink.hbase.shaded.io.netty.channel.EventLoopGroup
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 27 more
 

Issue Links

• links to: GitHub Pull Request #17