Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Duplicate
-
1.7.2, 1.8.0
-
None
-
None
-
- Flink 1.7.2 job on 1.8 cluster
- Kafka 0.10 with a topic in log-compaction
Description
Hi!
Yesterday, we saw a strange behavior with our Flink job and Kafka. We are consuming a Kafka topic setup in log-compaction mode. As such, sending a message with a null payload acts like a tombstone.
We are consuming Kafka like this:
new FlinkKafkaConsumer010<> ("topic", new SimpleStringSchema(), this.kafkaProperties)
When we sent the message, job failed because of a NullPointerException here. `byte[] message` was null, causing the NPE.
We forked the class and added a basic nullable check, returning null if so. It fixed our issue.
Should we add it to the main class?
Attachments
Issue Links
- duplicates
-
FLINK-11820 SimpleStringSchema handle message record which value is null
- Closed