Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1516

Producer Performance Test sends messages with bytes of 0x0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.8.1.1
    • None
    • None
    • None

    Description

      The producer performance test in Kafka sends messages with either 0x0 bytes or messages with all X's. This skews the compression ratio massively and probably affects performance in other ways.

      We want to create messages which will give a more realistic performance profile. Using random bytes may not be the best solution as these won't compress at all and will skew compression times.

      Perhaps using a template which injects random or sequential data into it could work. Or maybe I'm overthinking it and we should just go for random bytes. What other options do we have? Others seem to use random bytes like cassandra-stress.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-4432 ProducerPerformance.java : Add support to supply custom message payloads.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              danielcompton Daniel Compton
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: