[KAFKA-14065] kafka-clients version 2.3.0 can not process lz4 compression type

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 2.3.0
• Component/s: clients
• Assignee: Unassigned
• Reporter: lifa
• Created: 11/Jul/22 14:20
• Updated: 11/Jul/22 14:40

Description

kafka-clients version 2.3.0 can not  process message with  lz4 compression type

1.set message compression type :lz4

2.when consume messages exception happened:

org.apache.kafka.common.KafkaException: Received exception when fetching the next record from xxx-2-0(your topic and partition). If needed, please seek past the record to continue consumption.
Caused by: org.apache.kafka.common.KafkaException: java.io.IOException: Stream frame descriptor corrupted
Caused by: java.io.IOException: Stream frame descriptor corrupted
    at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.readHeader(KafkaLZ4BlockInputStream.java:132)
    at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.<init>(KafkaLZ4BlockInputStream.java:78)
    at org.apache.kafka.common.record.CompressionType$4.wrapForInput(CompressionType.java:110)
    ... 34 more