Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3852

Clarify how to handle message format upgrade without killing performance

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.10.0.0
    • 0.10.0.1, 0.10.1.0
    • None
    • None

    Description

      The upgrade notes re: performance impact of the message format change in 0.10.0.0 are a bit wishy washy in terms of what you ​should​ do. They describe the potential impact and then say (at the end of a paragraph): "To avoid such message conversion before consumers are upgraded to 0.10.0.0, one can set". This should probably be written as a playbook for doing the upgrade without affecting performance and should be a recommendation, not presented as just an option. Nobody with an existing cluster wants the perf impact of switching their brokers to the new format while consumers are still using the old format unless they have a cluster with extremely light load.

      Additionally, if we have some simple benchmark numbers on the performance impact on brokers, we should include that information. Today it is very unclear how bad that change will be – 5%, 20%, 90% worse?

      Attachments

        Issue Links

          Activity

            People

              ewencp Ewen Cheslack-Postava
              ewencp Ewen Cheslack-Postava
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: