Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4432

ProducerPerformance.java : Add support to supply custom message payloads.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 0.10.2.0
    • None
    • None

    Description

      Currently, kafka-producer-perf-test.sh does not support supplying custom payloads to read messages from. The payload generated is a static payload which is not very useful when testing features like compression.

      We can improve the ProducerPerformance.java to accept a "-payload-file" and "-payload-delimiter"(optional) parameters instead of "-record-size". This will enable to user to run performance tests using custom payloads.

      Before every send, we'll pick up a random payload from the payload-file provided.

      -payload-file: Will consists of messages delimited by "-payload-delimiter".
      -payload-delimiter: Takes a default value of "\n" if not specified.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-1516 Producer Performance Test sends messages with bytes of 0x0

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #2158

          Activity

            People

              Unassigned Unassigned
              sandeshsvs Sandesh Karkera
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: