Kafka
  1. Kafka
  2. KAFKA-1115

producer performance affected by trace/debug calls

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Incomplete
    • Affects Version/s: 0.8.0
    • Fix Version/s: None
    • Component/s: producer
    • Labels:
      None

      Description

      After investigating high CPU usage on some producers in production, we found out that a lot of time was passed in string construction for logging of DEBUG and TRACE level.

      This patch removes most of the logging calls, on our systems it cuts CPU usage down to half of what it used to be.

      Note that this is a significant boost in performance for environment where there are thousands of msg/s.

      1. producer-performance-fix.patch
        12 kB
        Francois Saint-Jacques

        Activity

        Francois Saint-Jacques created issue -
        Francois Saint-Jacques made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Francois Saint-Jacques made changes -
        Attachment producer-performance-fix.patch [ 12611695 ]
        Francois Saint-Jacques made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Joel Koshy made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Incomplete [ 4 ]

          People

          • Assignee:
            Francois Saint-Jacques
            Reporter:
            Francois Saint-Jacques
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development