[KAFKA-7920] Do not permit zstd use until inter.broker.protocol.version is updated to 2.1

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.1.0, 2.1.1
• Fix Version/s: 2.2.0, 2.1.2
• Component/s: core
• Assignee: Dongjin Lee
• Reporter: Jason Gustafson
• Created: 12/Feb/19 02:02
• Updated: 20/Feb/19 17:06
• Resolved: 20/Feb/19 17:06

Description

After brokers have been upgraded to 2.1, users can begin using zstd compression. Regardless of the inter.broker.protocol.version, the broker will happily accept zstd-compressed data as long as the right produce request version is used. However, if the inter.broker.protocol.version is set to 2.0 or below, then followers will not be able to use the minimum required fetch version, which will result in the following error:

[2019-02-11 17:42:47,116] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition foo-0 at offset 0 (kafka.server.ReplicaFetcherThread)                                                                                                                          
org.apache.kafka.common.errors.UnsupportedCompressionTypeException: The requesting client does not support the compression type of given partition.

We should make produce request validation consistent. Until the inter.broker.protocol.version is at 2.1 or later, we should reject produce requests with UNSUPPORTED_COMPRESSION_TYPE.

Issue Links

• links to: GitHub Pull Request #6256