[KAFKA-16955] ConcurrentModification exception thrown by KafkaStream threadState access

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.7.0
• Fix Version/s: 3.9.0, 3.7.2, 3.8.1
• Component/s: streams
• Assignee: Rohan Desai
• Reporter: Rohan Desai
• Created: 13/Jun/24 22:55
• Updated: 05/Nov/24 00:02
• Resolved: 14/Jun/24 17:45

Description

We see occasional ConcurrentModificationExceptions thrown when accessing threadState:

 

 

155.745service_application1 info[ERROR] 2024-06-11 07:56:42.417 [e2e-de9a85a4-b1d9-4807-bc34-e269f760bcd7-StreamThread-2] ResponsiveKafkaStreams - stream-client [e2e-de9a85a4-b1d9-4807-bc34-e269f760bcd7] Replacing thread in the streams uncaught exception handler155.745service_application1 infoorg.apache.kafka.streams.errors.StreamsException: java.util.ConcurrentModificationException155.745service_application1 info	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:729) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:645) [kafka-streams-3.7.0.jar:?]155.745service_application1 infoCaused by: java.util.ConcurrentModificationException155.745service_application1 info	at java.util.HashMap$HashIterator.nextNode(HashMap.java:1605) ~[?:?]155.745service_application1 info	at java.util.HashMap$ValueIterator.next(HashMap.java:1633) ~[?:?]155.745service_application1 info	at org.apache.kafka.streams.KafkaStreams$StreamStateListener.maybeSetRunning(KafkaStreams.java:656) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	at org.apache.kafka.streams.KafkaStreams$StreamStateListener.onChange(KafkaStreams.java:686) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	at org.apache.kafka.streams.processor.internals.StreamThread.setState(StreamThread.java:261) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	at org.apache.kafka.streams.processor.internals.StreamThread.initializeAndRestorePhase(StreamThread.java:1120) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	at org.apache.kafka.streams.processor.internals.StreamThread.runOnceWithoutProcessingThreads(StreamThread.java:921) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:686) ~[kafka-streams-3.7.0.jar:?]155.745service_application1 info	... 1 more 

 

 

Issue Links

• links to: GitHub Pull Request #16337