[KAFKA-7632] Support Compression Level

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.1.0
• Component/s: clients
• Labels: needs-kip
• Environment: all
• External issue URL: https://github.com/apache/kafka/pull/2267#issuecomment-439087933
• Assignee: Dongjin Lee
• Reporter: Dave Waters
• Reviewer: Dongjin Lee
• Created: 15/Nov/18 16:26
• Updated: 10/Apr/24 17:43

Description

The compression level for ZSTD is currently set to use the default level (3), which is a conservative setting that in some use cases eliminates the value that ZSTD provides with improved compression. Each use case will vary, so exposing the level as a producer, broker, and topic configuration setting will allow the user to adjust the level.

Since it applies to the other compression codecs, we should add the same functionalities to them.

Issue Links

• is related to: KAFKA-13361 Support fine-grained compression options
• links to: GitHub Pull Request #5927
• links to: GitHub Pull Request #10826
• links to: GitHub Pull Request #15516