Details
-
Bug
-
Status: Open
-
Not a Priority
-
Resolution: Unresolved
-
1.10.0
-
None
Description
Stream don't catch exception for bad packet in kafka, exception terminate thread.
org.apache.kafka.common.KafkaException: Received exception when fetching the next record from prod_netscout_ug_s1mme-14. If needed, please seek past the record to continue consumption.org.apache.kafka.common.KafkaException: Received exception when fetching the next record from prod_netscout_ug_s1mme-14. If needed, please seek past the record to continue consumption. at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.fetchRecords(Fetcher.java:1522) at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.access$1700(Fetcher.java:1377) at org.apache.kafka.clients.consumer.internals.Fetcher.fetchRecords(Fetcher.java:677) at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:632) at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1290) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1248) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1173) at org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread.run(KafkaConsumerThread.java:253)Caused by: org.apache.kafka.common.KafkaException: Record batch for partition prod_netscout_ug_s1mme-14 at offset 22405513471 is invalid, cause: Record is corrupt (stored crc = 995400728, computed crc = 4153305836) at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.maybeEnsureValid(Fetcher.java:1435) at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.nextFetchedRecord(Fetcher.java:1479) at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.fetchRecords(Fetcher.java:1536) ... 7 more