Kafka
  1. Kafka
  2. KAFKA-1498

new producer performance and bug improvements

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: core
    • Labels:
      None

      Description

      We have seen the following issues with the new producer.

      1. The producer request can be significantly larger than the configured batch size.
      2. The bottleneck in mirrormaker when there are keyed messages and compression is turned on.
      3. The selector is woken up on every message in the new producer.

      1. kafka-1498.patch
        33 kB
        Jun Rao
      2. KAFKA-1498.patch
        35 kB
        Guozhang Wang
      3. KAFKA-1498_2014-06-25_16:44:51.patch
        36 kB
        Guozhang Wang
      4. KAFKA-1498_2014-06-30_10:47:17.patch
        41 kB
        Guozhang Wang
      5. KAFKA-1498_2014-06-30_15:47:56.patch
        41 kB
        Guozhang Wang
      6. KAFKA-1498_2014-07-01_11:12:41.patch
        41 kB
        Guozhang Wang
      7. KAFKA-1498.patch
        0.9 kB
        Guozhang Wang

        Activity

          People

          • Assignee:
            Guozhang Wang
            Reporter:
            Jun Rao
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development