Details
-
New Feature
-
Status: Closed
-
Major
-
Resolution: Implemented
-
None
-
Kafka 0.11.0.0
Flink 1.4.0
flink-connector-kafka-0.11_2.11
Description
This allows using all fields that Kafka offers on ProducerRecord, for example, timestamps and headers.
Old Text
Kafka has introduced notion of Header for messages in version 0.11.0.0 https://issues.apache.org/jira/browse/KAFKA-4208.
But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.
It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
Attachments
Issue Links
- is a clone of
-
FLINK-8354 Add KafkaDeserializationSchema that directly uses ConsumerRecord
- Closed
- is duplicated by
-
FLINK-11303 Utilizing Kafka headers for serialization and deserialization
- Closed
-
FLINK-11647 Use message headers in flink kafka connectors
- Closed
- links to