[KAFKA-5349] KafkaConsumer occasionally hits IllegalStateException

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0.0
• Assignee: Jason Gustafson
• Reporter: Apurva Mehta
• Created: 30/May/17 22:30
• Updated: 31/May/17 09:31
• Resolved: 31/May/17 09:31

Description

I have noticed the following while debugging system tests. Sometimes a plain old console consumer hits the following exception when reading from a topic:

[2017-05-30 22:16:55,686] ERROR Unknown error when running consumer:  (kafka.tools.ConsoleConsumer$)
java.lang.IllegalStateException: Invalid attempt to complete a request future which is already complete
        at org.apache.kafka.clients.consumer.internals.RequestFuture.raise(RequestFuture.java:145)
        at org.apache.kafka.clients.consumer.internals.RequestFuture.raise(RequestFuture.java:158)
        at org.apache.kafka.clients.consumer.internals.Fetcher.handleListOffsetResponse(Fetcher.java:744)
        at org.apache.kafka.clients.consumer.internals.Fetcher.access$2000(Fetcher.java:91)
        at org.apache.kafka.clients.consumer.internals.Fetcher$3.onSuccess(Fetcher.java:688)
        at org.apache.kafka.clients.consumer.internals.Fetcher$3.onSuccess(Fetcher.java:683)
        at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:204)
        at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:167)
        at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:127)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:488)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:348)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:262)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:208)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:184)
        at org.apache.kafka.clients.consumer.internals.Fetcher.retrieveOffsetsByTimes(Fetcher.java:451)
        at org.apache.kafka.clients.consumer.internals.Fetcher.resetOffsets(Fetcher.java:409)
        at org.apache.kafka.clients.consumer.internals.Fetcher.updateFetchPositions(Fetcher.java:282)
        at org.apache.kafka.clients.consumer.KafkaConsumer.updateFetchPositions(KafkaConsumer.java:1614)
        at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1055)
        at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1015)
        at kafka.consumer.NewShinyConsumer.<init>(BaseConsumer.scala:58)
        at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:72)
        at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:53)
        at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)

Issue Links

• links to: GitHub Pull Request #3175