[KAFKA-3950] kafka mirror maker tool is not respecting whitelist option

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.9.0.0
• Fix Version/s: 0.10.0.1
• Assignee: Manikumar
• Reporter: Raghav Kumar Gautam
• Reviewer: Ismael Juma
• Created: 12/Jul/16 00:17
• Updated: 31/Jul/16 12:54
• Resolved: 31/Jul/16 09:06

Description

A mirror maker launched like this:

/usr/bin/kinit -k -t /home/kfktest/hadoopqa/keytabs/kfktest.headless.keytab [e-mail]
JAVA_HOME=/usr/jdk64/jdk1.8.0_77 JMX_PORT=9112 /usr/kafka/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/config/mirror_consumer_12.properties --producer.config /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/config/mirror_producer_12.properties --new.consumer --whitelist="test.*" >>  /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/logs/mirror_maker-12/mirror_maker_12.log 2>&1 & echo pid:$! >  /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/logs/mirror_maker-12/entity_12_pid

Lead to TopicAuthorizationException:

WARN Error while fetching metadata with correlation id 44 : {__consumer_offsets=TOPIC_AUTHORIZATION_FAILED} (org.apache.kafka.clients.NetworkClient)
[2016-06-20 13:24:49,983] FATAL [mirrormaker-thread-0] Mirror maker thread failure due to  (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [__consumer_offsets]

Issue Links

• links to: GitHub Pull Request #1615
• links to: GitHub Pull Request #1687