[KAFKA-7907] KafkaDistributed - Unknown datum class: class java.lang.Short

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.1.0
• Component/s: connect
• Labels: converter external invalid
• Assignee: Unassigned
• Reporter: Blanchard Matthieu
• Created: 07/Feb/19 11:48
• Updated: 07/Feb/19 18:48
• Resolved: 07/Feb/19 18:46

Description

I try today to upgrade my kafka confluent from 5.0.0 to 5.1.0.

It use now kafka 2.1.0.

When I try to create my connectors (dbz sql connector), when it worked in 2.0.0, I've got now this error : 

org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler
 at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:178)
 at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execute(RetryWithToleranceOperator.java:104)
 at org.apache.kafka.connect.runtime.WorkerSourceTask.convertTransformedRecord(WorkerSourceTask.java:269)
 at org.apache.kafka.connect.runtime.WorkerSourceTask.sendRecords(WorkerSourceTask.java:293)
 at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:228)
 at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:175)
 at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:219)
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.avro.AvroRuntimeException: Unknown datum class: class java.lang.Short
 at org.apache.avro.util.internal.JacksonUtils.toJson(JacksonUtils.java:87)
 at org.apache.avro.util.internal.JacksonUtils.toJsonNode(JacksonUtils.java:48)
 at org.apache.avro.Schema$Field.<init>(Schema.java:423)
 at org.apache.avro.Schema$Field.<init>(Schema.java:415)
 at io.confluent.connect.avro.AvroData.addAvroRecordField(AvroData.java:964)
 at io.confluent.connect.avro.AvroData.fromConnectSchema(AvroData.java:847)
 at io.confluent.connect.avro.AvroData.fromConnectSchemaWithCycle(AvroData.java:942)
 at io.confluent.connect.avro.AvroData.fromConnectSchema(AvroData.java:834)
 at io.confluent.connect.avro.AvroData.fromConnectSchema(AvroData.java:689)
 at io.confluent.connect.avro.AvroData.fromConnectSchema(AvroData.java:683)
 at io.confluent.connect.avro.AvroData.fromConnectData(AvroData.java:328)
 at io.confluent.connect.avro.AvroConverter.fromConnectData(AvroConverter.java:76)
 at org.apache.kafka.connect.runtime.WorkerSourceTask.lambda$convertTransformedRecord$2(WorkerSourceTask.java:269)
 at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndRetry(RetryWithToleranceOperator.java:128)
 at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:162)
 ... 11 more
[2019-02-07 12:39:46,301] ERROR WorkerSourceTask\{id=resa2ToKafka-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:178)