[FLUME-3026] Add Kafka 0.10 support for Flume

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.7.0
• Fix Version/s: 1.10.1
• Component/s: Channel, Sinks+Sources
• Assignee: Unassigned
• Reporter: Ping Wang
• Created: 18/Nov/16 09:00
• Updated: 26/Aug/22 05:03
• Resolved: 26/Aug/22 05:03

Description

Kafka 0.10 already released and it introduces some new APIs that not compatible with old one. When using Kafka 0.10, the unit test cases will hit compilation error:
...
[ERROR] /root/flume/flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/TestKafkaSink.java:[526,14] error: method createTopic in class AdminUtils cannot be applied to given types;
...
[ERROR] /root/flume/flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/TestKafkaSource.java:[23,19] error: cannot find symbol
[ERROR] package kafka.common
[ERROR] /root/flume/flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/TestKafkaSource.java:[109,13] error: cannot find symbol
[ERROR] class TestKafkaSource
[ERROR] /root/flume/flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/KafkaSourceEmbeddedKafka.java:[134,14] error: method createTopic in class AdminUtils cannot be applied to given types;
...

Issue Links

• duplicates: FLUME-3398 Upgrade Kafka to a supported version.
• relates to: FLUME-2933 Does Flume support Kafka 0.10 version