Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9754

Trogdor workloads fail because topics are not fully created when workloads start.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: system tests
    • Labels:
      None

      Description

      In many instances, when running with high partition counts, trogdor ProduceBench workloads have been failing with the following error:

      This server does not host this topic-partition. 

      This is caused by the test not checking that the topic is fully created before starting to produce to it.

      As far as I see it, there are 2 options here:

      1. Check the topic status at the beginning of the test and wait for the topic to be in a healthy state.
      2. Add exception handling around the SendRecords call to allow for ignoring these failures and continuing.

      #2 would be easier than #1, however they both have trade-offs.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                scott.hendricks Scott Hendricks
                Reporter:
                scott.hendricks Scott Hendricks
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: