Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1498

new producer performance and bug improvements

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • core
    • None

    Description

      We have seen the following issues with the new producer.

      1. The producer request can be significantly larger than the configured batch size.
      2. The bottleneck in mirrormaker when there are keyed messages and compression is turned on.
      3. The selector is woken up on every message in the new producer.

      Attachments

        1. kafka-1498.patch
          33 kB
          Jun Rao
        2. KAFKA-1498.patch
          35 kB
          Guozhang Wang
        3. KAFKA-1498_2014-06-25_16:44:51.patch
          36 kB
          Guozhang Wang
        4. KAFKA-1498_2014-06-30_10:47:17.patch
          41 kB
          Guozhang Wang
        5. KAFKA-1498_2014-06-30_15:47:56.patch
          41 kB
          Guozhang Wang
        6. KAFKA-1498_2014-07-01_11:12:41.patch
          41 kB
          Guozhang Wang
        7. KAFKA-1498.patch
          0.9 kB
          Guozhang Wang

        Activity

          People

            guozhang Guozhang Wang
            junrao Jun Rao
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: