Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3965

Mirror maker sync send fails will lose messages

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.10.0.0
    • Fix Version/s: 0.10.1.0
    • Component/s: core
    • Labels:
      None
    • Environment:
      SUSE Linux Enterprise Server 11 (x86_64)

      Description

      1、Source kafka cluster storage some messages and message size is 500 bytes.
      2、Mirror maker producer config
      producer.type=sync
      max.request.size=400
      3、Start mirror maker backup message from source kafka cluster to destination kafka cluster, then mirror maker will quit because message larger than 400.
      4、Check source kafka cluster will find offset have set to 1.
      5、Check destination kafka cluster, then find have not any message.
      6、Delete producer config max.request.size=400,start mirror maker again. Wait mirror maker finish backup, then find have lose the first message.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                becket_qin Jiangjie Qin
                Reporter:
                niew37 NieWang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: