[KAFKA-6524] kafka mirror can't producer internal topic

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Information Provided
• Affects Version/s: 1.0.0
• Component/s: producer
• Assignee: Unassigned
• Reporter: Ahmed Madkour
• Created: 02/Feb/18 10:49
• Updated: 07/Feb/18 14:05
• Resolved: 07/Feb/18 14:05

Description

We are using kafka-mirror-maker.sh to consume data from a 3 brokers kafka cluster and producer the data to another single broker kafka cluster

We want to include internal topics so we added the following in the consumer configuration
exclude.internal.topics=false

We keep receiving the following errors:

org.apache.kafka.common.errors.InvalidTopicException: The request attempted to perform an operation on an invalid topic.

 ERROR Error when sending message to topic __consumer_offsets with key: 43 bytes, value: 28 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)

It seems that the producer can't access the internal topic __consumer_offsets.

Any way to fix that?