[KAFKA-4095] When a topic is deleted and then created with the same name, 'committed' offsets are not reset

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.0.1, 0.10.0.0
• Component/s: consumer
• Assignee: Vahid Hashemian
• Reporter: Alex Glikson
• Created: 28/Aug/16 15:42
• Updated: 08/Jul/18 02:17
• Resolved: 08/Jul/18 02:17

Description

I encountered a very strange behavior of Kafka, which seems to be a bug.
After deleting a topic and re-creating it with the same name, I produced certain amount of new messages, and then opened a consumer with the same ID that I used before re-creating the topic (with auto.commit=false, auto.offset.reset=earliest). While the latest offsets seemed up to date, the committed offset (returned by committed() method) was an old offset, from the time before the topic has been deleted and created.
I would have assumed that when a topic is deleted, all the associated topic-partitions and consumer groups are recycled too.
I am using the Java client version 0.9, with Kafka server 0.10.

Issue Links

• relates to: KAFKA-4456 Offsets of deleted topics are not removed from consumer groups
• links to: GitHub Pull Request #2160
• links to: GitHub Pull Request #2160