[KAFKA-17527] Kafka Streams fails with NPE for missing RecordContext - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: 3.9.0
Fix Version/s: 3.9.0
Component/s: streams
Labels:
None

Description

He did observe a crash of Kafka Streams with the following stack trace:

2024-09-10 10:59:12,301] ERROR [kafka-producer-network-thread | i-0197827b22f4d4e4c-StreamThread-1-producer] Error executing user-provided callback on message for topic-partition 'stream-soak-test-KSTREAM-AGGREGATE-STATE-STORE-0000000047-changelog-1' (org.apache.kafka.clients.producer.internals.ProducerBatch)
java.lang.NullPointerException: Cannot invoke "org.apache.kafka.streams.processor.internals.InternalProcessorContext.recordContext()" because "context" is null
    at org.apache.kafka.streams.processor.internals.RecordCollectorImpl.recordSendError(RecordCollectorImpl.java:405)
    at org.apache.kafka.streams.processor.internals.RecordCollectorImpl.lambda$send$1(RecordCollectorImpl.java:285)
    at org.apache.kafka.clients.producer.KafkaProducer$AppendCallbacks.onCompletion(KafkaProducer.java:1574)
    at org.apache.kafka.clients.producer.internals.ProducerBatch.completeFutureAndFireCallbacks(ProducerBatch.java:312)
    at org.apache.kafka.clients.producer.internals.ProducerBatch.abort(ProducerBatch.java:200)
    at org.apache.kafka.clients.producer.internals.RecordAccumulator.abortUndrainedBatches(RecordAccumulator.java:1166)
    at org.apache.kafka.clients.producer.internals.Sender.maybeSendAndPollTransactionalRequest(Sender.java:474)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:337)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:251)
    at java.base/java.lang.Thread.run(Thread.java:840)

It seems to be a bug introduced via KIP-1033, coming from the changelogging layer which does pass a `null` context into `RecordCollector.send(...)`.