[KAFKA-10133] Cannot compress messages in destination cluster with MM2

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.4.0, 2.5.0, 2.4.1
• Fix Version/s: 2.7.0
• Component/s: mirrormaker
• Environment: kafka 2.5.0 deployed via the strimzi operator 0.18
• Assignee: Ning Zhang
• Reporter: Steve Jacobs
• Created: 09/Jun/20 23:56
• Updated: 03/Jan/24 23:01
• Resolved: 04/Sep/20 17:26

Description

When configuring mirrormaker2 using kafka connect, it is not possible to configure things such that messages are compressed in the destination cluster. Dump Log shows that batching is occuring, but no compression. If this is possible, then this is a documentation bug, because I can find no documentation on how to do this.

baseOffset: 4208 lastOffset: 4492 count: 285 baseSequence: -1 lastSequence: -1 producerId: -1 producerEpoch: -1 partitionLeaderEpoch: 2 isTransactional: false isControl: false position: 239371 CreateTime: 1591745894859 size: 16362 magic: 2 compresscodec: NONE crc: 1811507259 isvalid: true

 

 

Issue Links

• links to: GitHub Pull Request #9215