[KAFKA-6237] stream stopped working after exception: Cannot execute transactional method because we are in an error state

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Cannot Reproduce
• Component/s: core, streams
• Labels: exactly-once
• Assignee: Unassigned
• Reporter: DHRUV BANSAL
• Created: 20/Nov/17 10:07
• Updated: 15/May/20 02:22
• Resolved: 15/May/20 02:22

Description

017-11-19 07:52:44,673 [project_logs_stream-a30ea242-3c9f-46a9-a01c-51903bd40ca5-StreamThread-1] ERROR: org.apache.kafka.streams.processor.internals.StreamThread - stream-thread [orion_logs_stream-a30ea242-3c9f-46a9-a01c-51903bd40ca5-StreamThread-1] Failed while closing StreamTask 0_1:
org.apache.kafka.common.KafkaException: Cannot execute transactional method because we are in an error state
at org.apache.kafka.clients.producer.internals.TransactionManager.maybeFailWithError(TransactionManager.java:524)
at org.apache.kafka.clients.producer.internals.TransactionManager.beginAbort(TransactionManager.java:198)
at org.apache.kafka.clients.producer.KafkaProducer.abortTransaction(KafkaProducer.java:598)
at org.apache.kafka.streams.processor.internals.StreamTask.close(StreamTask.java:434)
at org.apache.kafka.streams.processor.internals.StreamThread.shutdownTasksAndState(StreamThread.java:1086)
at org.apache.kafka.streams.processor.internals.StreamThread.shutdown(StreamThread.java:1041)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:538)
Caused by: org.apache.kafka.common.KafkaException: Unexpected error in AddOffsetsToTxnResponse: The server experienced an unexpected error when processing the request
at org.apache.kafka.clients.producer.internals.TransactionManager$AddOffsetsToTxnHandler.handleResponse(TransactionManager.java:978)
at org.apache.kafka.clients.producer.internals.TransactionManager$TxnRequestHandler.onComplete(TransactionManager.java:648)
at org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:101)
at org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:454)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:446)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:206)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:162)
at java.lang.Thread.run(Thread.java:745)

Also when I see the state of the corresponding consumer group it is saying:
Warning: Consumer group is rebalancing.

Issue Links

• duplicates: KAFKA-5603 Streams should not abort transaction when closing zombie task