[KAFKA-7549] Old ProduceRequest with zstd compression does not return error to client

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0, 2.1.1
• Component/s: compression
• Assignee: Dongjin Lee
• Reporter: Magnus Edenhill
• Created: 25/Oct/18 09:50
• Updated: 10/Dec/18 17:48
• Resolved: 10/Dec/18 17:48

Description

Kafka broker v2.1.0rc0.

 

KIP-110 states that:

"Zstd will only be allowed for the bumped produce API. That is, for older version clients(=below KAFKA_2_1_IV0), we return UNSUPPORTED_COMPRESSION_TYPE regardless of the message format."

 

However, sending a ProduceRequest V3 with zstd compression (which is a client side bug) closes the connection with the following exception rather than returning UNSUPPORTED_COMPRESSION_TYPE in the ProduceResponse:

 

[2018-10-25 11:40:31,813] ERROR Exception while processing request from 127.0.0.1:60723-127.0.0.1:60656-94 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 3, connectionId: 127.0.0.1:60723-127.0.0.1:60656-94, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: org.apache.kafka.common.record.InvalidRecordException: Produce requests with version 3 are note allowed to use ZStandard compression

Issue Links

• links to: GitHub Pull Request #5925