[KAFKA-4505] Cannot get topic lag since kafka upgrade from 0.8.1.0 to 0.10.1.0

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Auto Closed
• Affects Version/s: 0.10.1.0
• Component/s: consumer, metrics, offset manager
• Assignee: Unassigned
• Reporter: Romaric Parmentier
• Created: 07/Dec/16 16:58
• Updated: 24/May/18 11:22
• Resolved: 24/May/18 11:22

Description

We were using kafka 0.8.1.1 and we just migrate to version 0.10.1.0.

Since we migrate we are using the new script kafka-consumer-groups.sh to retreive topic lags but it don't seem to work anymore.
Because the application is using the 0.8 driver we have added the following conf to each kafka servers:
log.message.format.version=0.8.2
inter.broker.protocol.version=0.10.0.0

When I'm using the option --list with kafka-consumer-groups.sh I can see every consumer groups I'm using but the --describe is not working:
/usr/share/kafka$ bin/kafka-consumer-groups.sh --zookeeper ip:2181 --describe --group group_name
No topic available for consumer group provided
GROUP TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG OWNER

When I'm looking into zookeeper I can see the offset increasing for this consumer group.

Any idea ?