Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2338

Warn users if they change max.message.bytes that they also need to update broker and consumer settings

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.8.2.1
    • Fix Version/s: 0.9.0.0
    • Component/s: core
    • Labels:
      None

      Description

      We already have KAFKA-1756 filed to more completely address this issue, but it is waiting for some other major changes to configs to completely protect users from this problem.

      This JIRA should address the low hanging fruit to at least warn users of the potential problems. Currently the only warning is in our documentation.

      1. Generate a warning in the kafka-topics.sh tool when they change this setting on a topic to be larger than the default. This needs to be very obvious in the output.
      2. Currently, the broker's replica fetcher isn't logging any useful error messages when replication can't succeed because a message size is too large. Logging an error here would allow users that get into a bad state to find out why it is happening more easily. (Consumers should already be logging a useful error message.)

        Attachments

        1. KAFKA-2338_2015-07-18_00:37:31.patch
          4 kB
          Edward Ribeiro
        2. KAFKA-2338_2015-07-21_13:21:19.patch
          3 kB
          Edward Ribeiro
        3. KAFKA-2338_2015-08-24_14:32:38.patch
          6 kB
          Edward Ribeiro
        4. KAFKA-2338_2015-09-02_19:27:17.patch
          6 kB
          Edward Ribeiro
        5. KAFKA-2338.patch
          6 kB
          Edward Ribeiro

          Issue Links

            Activity

              People

              • Assignee:
                benstopford Ben Stopford
                Reporter:
                ewencp Ewen Cheslack-Postava
                Reviewer:
                Gwen Shapira
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: