[FLUME-2846] flume-kafka-sink uses new kafka producer API

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.6.0
• Component/s: Sinks+Sources
• Assignee: Unassigned
• Reporter: Xin Wang
• Created: 28/Nov/15 13:47
• Updated: 28/Nov/15 13:58

Description

why use new producer API?
because this new client is "both faster and more fully featured than the previous Scala client".

changes are following:
1. add kafka-clients dependency to flume-parent/pom.xml and flume-ng-kafka-sink.xml
2. use new producer api in KafkaSink
3. update producer configs in KafkaSinkConstants
4. update unit tests.