Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2338

Warn users if they change max.message.bytes that they also need to update broker and consumer settings

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.8.2.1
    • 0.9.0.0
    • core
    • None

    Description

      We already have KAFKA-1756 filed to more completely address this issue, but it is waiting for some other major changes to configs to completely protect users from this problem.

      This JIRA should address the low hanging fruit to at least warn users of the potential problems. Currently the only warning is in our documentation.

      1. Generate a warning in the kafka-topics.sh tool when they change this setting on a topic to be larger than the default. This needs to be very obvious in the output.
      2. Currently, the broker's replica fetcher isn't logging any useful error messages when replication can't succeed because a message size is too large. Logging an error here would allow users that get into a bad state to find out why it is happening more easily. (Consumers should already be logging a useful error message.)

      Attachments

        1. KAFKA-2338_2015-07-18_00:37:31.patch
          4 kB
          Edward Ribeiro
        2. KAFKA-2338_2015-07-21_13:21:19.patch
          3 kB
          Edward Ribeiro
        3. KAFKA-2338_2015-08-24_14:32:38.patch
          6 kB
          Edward Ribeiro
        4. KAFKA-2338_2015-09-02_19:27:17.patch
          6 kB
          Edward Ribeiro
        5. KAFKA-2338.patch
          6 kB
          Edward Ribeiro

        Issue Links

          Activity

            People

              benstopford Ben Stopford
              ewencp Ewen Cheslack-Postava
              Gwen Shapira Gwen Shapira
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: