[FLUME-2874] A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.6.0
• Assignee: Unassigned
• Reporter: Li Ye
• Created: 02/Feb/16 06:10
• Updated: 25/Mar/16 03:46
• Resolved: 25/Mar/16 03:45

Description

Kafka Sink uses the topic and key properties from the FlumeEvent headers to send events to Kafka. If topic exists in the headers, the event will be sent to that specific topic, overriding the topic configured for the Sink. If key exists in the headers, the key will used by Kafka to partition the data between the topic partitions. Events with same key will be sent to the same partition. If the key is null, events will be sent to random partitions.
If there is a new interceptor called Key Interceptor to insert a header with key "key", much convienience will be brought to Kafka Sink users.