[HUDI-3903] Kafka Connect Hudi Sink sees NoClassDefFoundError: org/apache/hudi/schema/FilebasedSchemaProvider

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Labels: pull-request-available
• Story Points: 2
• Epic Link: Hudi Kafka Connect
• Assignee: Ethan Guo
• Reporter: Ethan Guo
• Created: 18/Apr/22 22:14
• Updated: 19/Apr/22 02:21
• Resolved: 19/Apr/22 02:21

Description

When following the quick start guide of kafka connect hudi sink, I encountered the following NoClassDefFoundError exception:

[2022-04-18 11:05:35,444] ERROR [hudi-sink|task-1] WorkerSinkTask{id=hudi-sink-1} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:193)
java.lang.NoClassDefFoundError: org/apache/hudi/schema/FilebasedSchemaProvider
    at org.apache.hudi.connect.writers.KafkaConnectConfigs.<clinit>(KafkaConnectConfigs.java:57)
    at org.apache.hudi.connect.HoodieSinkTask.start(HoodieSinkTask.java:80)
    at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:308)
    at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:196)
    at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:186)
    at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:241)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.hudi.schema.FilebasedSchemaProvider
    at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
    at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:103)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
    ... 11 more
[2022-04-18 11:05:35,444] ERROR [hudi-sink|task-0] WorkerSinkTask{id=hudi-sink-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:193)
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hudi.connect.writers.KafkaConnectConfigs
    at org.apache.hudi.connect.HoodieSinkTask.start(HoodieSinkTask.java:80)
    at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:308)
    at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:196)
    at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:186)
    at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:241)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
 

Issue Links

• links to: GitHub Pull Request #5353