-
Type:
New Feature
-
Status: Closed
-
Priority:
Major
-
Resolution: Implemented
-
Affects Version/s: None
-
Fix Version/s: 1.9.0
-
Component/s: Connectors / Kafka
-
Labels:
-
Environment:
Kafka 0.11.0.0
Flink 1.4.0
flink-connector-kafka-0.11_2.11
-
Release Note:
This allows using all fields that Kafka offers on ProducerRecord, for example, timestamps and headers.
Old Text
Kafka has introduced notion of Header for messages in version 0.11.0.0 https://issues.apache.org/jira/browse/KAFKA-4208.
But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.
It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
- is a clone of
-
FLINK-8354 Add KafkaDeserializationSchema that directly uses ConsumerRecord
-
- Closed
-
- is duplicated by
-
FLINK-11303 Utilizing Kafka headers for serialization and deserialization
-
- Closed
-
-
FLINK-11647 Use message headers in flink kafka connectors
-
- Closed
-
- links to