[CAMEL-20790] kafka batching consumer polls randomly failing with NPE under load

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 4.4.2, 4.6.0
• Fix Version/s: 4.4.3, 4.7.0
• Component/s: camel-kafka
• Labels: help-wanted
• Estimated Complexity: Unknown
• Assignee: Otavio Rodolfo Piske
• Reporter: Ihar Reznichenka
• Created: 20/May/24 10:19
• Updated: 17/Jun/24 05:30
• Resolved: 15/Jun/24 05:29

Description

A camel-kafka batching consumer is randomly catching NPEs.

This is happening with and w/o manual commit.

If the consumer is configured with pollOnError=RETRY then it causes lost records.

Please find a test to reproduce the issue attached.

 

 

java.lang.NullPointerException: Cannot invoke "java.util.List.add(Object)" because "this.exchangeList" is null
    at org.apache.camel.component.kafka.consumer.support.batching.KafkaRecordBatchingProcessor.processExchange(KafkaRecordBatchingProcessor.java:137)
    at org.apache.camel.component.kafka.consumer.support.batching.KafkaRecordBatchingProcessorFacade.processPolledRecords(KafkaRecordBatchingProcessorFacade.java:59)
    at org.apache.camel.component.kafka.KafkaFetchRecords.startPolling(KafkaFetchRecords.java:353)
    at org.apache.camel.component.kafka.KafkaFetchRecords.run(KafkaFetchRecords.java:173)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:264)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:840) 

 

Please let me know if any additional details are required here.

 

Issue Links

• links to: GitHub Pull Request #14481
• links to: GitHub Pull Request #14537