Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3677

Add a producer performance tuning tool

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In general, the producer of Kafka needs to be tuned based on the user traffic pattern in order to get the optimal performance. It would be useful to provide a tool that helps user explore different settings based on the user traffic pattern (message size, compression type and ratio).

      This ticket will use ProducerPerformance with synthetic traffic of the data pattern specified by user to to explore different producer configurations and offer performance tuning suggestions to the users.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-2499 kafka-producer-perf-test should use something more realistic than empty byte arrays

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-3554 Generate actual data with specific compression ratio and add multi-thread support in the ProducerPerformance tool.

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              becket_qin Jiangjie Qin
              becket_qin Jiangjie Qin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: