Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10133

Cannot compress messages in destination cluster with MM2

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.4.0, 2.5.0, 2.4.1
    • Fix Version/s: 2.7.0
    • Component/s: mirrormaker
    • Labels:
      None
    • Environment:
      kafka 2.5.0 deployed via the strimzi operator 0.18

      Description

      When configuring mirrormaker2 using kafka connect, it is not possible to configure things such that messages are compressed in the destination cluster. Dump Log shows that batching is occuring, but no compression. If this is possible, then this is a documentation bug, because I can find no documentation on how to do this.

      baseOffset: 4208 lastOffset: 4492 count: 285 baseSequence: -1 lastSequence: -1 producerId: -1 producerEpoch: -1 partitionLeaderEpoch: 2 isTransactional: false isControl: false position: 239371 CreateTime: 1591745894859 size: 16362 magic: 2 compresscodec: NONE crc: 1811507259 isvalid: true

       

       

        Attachments

          Activity

            People

            • Assignee:
              yangguo1220 Ning Zhang
              Reporter:
              steveatbat Steve Jacobs

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment