[FLUME-3327] Add method to convrt headers of flume event and ones of kafka record transparently.

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9.0
• Component/s: Kafka Channel, Sinks+Sources
• Assignee: Unassigned
• Reporter: Takafumi Saito
• Created: 03/Apr/19 09:58
• Updated: 08/Oct/22 04:41

Description

The only way of delivering headers in flume event to kafka now is serializing event as Avro format of Flume and set it body of kafka.
In kafka 0.11.0.0, record header is released as new feature.
If using headers of flume and one of kafka transparently, we do not need to serialize event.
We add `useKafkaHeader` option to select using record headers of kafka or not.
By default, the useKafkaHeader option is false because of considering compatibility.

Issue Links

• links to: GitHub Pull Request #280