[FLINK-11647] Use message headers in flink kafka connectors

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: Connectors / Kafka
• Assignee: Unassigned
• Reporter: Sergey Starokozhev
• Created: 18/Feb/19 09:41
• Updated: 22/Feb/19 11:23
• Resolved: 20/Feb/19 15:37

Description

It is required to add the ability to use kafka message headers in class FlinkKafkaConsumer. This will make it possible, for example, to use different avro message schemes. Now we can only use key, value, topic, partiotion and offset but not headers: [Kafka09Fetcher.java -142]:  

final T value = deserializer.deserialize(
record.key(), record.value(),
record.topic(), record.partition(), record.offset());

Issue Links

• duplicates: FLINK-8354 Add KafkaDeserializationSchema that directly uses ConsumerRecord
• duplicates: FLINK-11693 Add KafkaSerializationSchema that directly uses ProducerRecord