Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1498

new producer performance and bug improvements

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: core
    • Labels:
      None

      Description

      We have seen the following issues with the new producer.

      1. The producer request can be significantly larger than the configured batch size.
      2. The bottleneck in mirrormaker when there are keyed messages and compression is turned on.
      3. The selector is woken up on every message in the new producer.

        Attachments

        1. KAFKA-1498.patch
          0.9 kB
          Guozhang Wang
        2. KAFKA-1498_2014-07-01_11:12:41.patch
          41 kB
          Guozhang Wang
        3. KAFKA-1498_2014-06-30_15:47:56.patch
          41 kB
          Guozhang Wang
        4. KAFKA-1498_2014-06-30_10:47:17.patch
          41 kB
          Guozhang Wang
        5. KAFKA-1498_2014-06-25_16:44:51.patch
          36 kB
          Guozhang Wang
        6. KAFKA-1498.patch
          35 kB
          Guozhang Wang
        7. kafka-1498.patch
          33 kB
          Jun Rao

          Activity

            People

            • Assignee:
              guozhang Guozhang Wang
              Reporter:
              junrao Jun Rao
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: