Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2338

Warn users if they change max.message.bytes that they also need to update broker and consumer settings

Agile BoardAttach filesAttach ScreenshotVotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.8.2.1
    • 0.9.0.0
    • core
    • None

    Description

      We already have KAFKA-1756 filed to more completely address this issue, but it is waiting for some other major changes to configs to completely protect users from this problem.

      This JIRA should address the low hanging fruit to at least warn users of the potential problems. Currently the only warning is in our documentation.

      1. Generate a warning in the kafka-topics.sh tool when they change this setting on a topic to be larger than the default. This needs to be very obvious in the output.
      2. Currently, the broker's replica fetcher isn't logging any useful error messages when replication can't succeed because a message size is too large. Logging an error here would allow users that get into a bad state to find out why it is happening more easily. (Consumers should already be logging a useful error message.)

      Attachments

        1. KAFKA-2338_2015-07-18_00:37:31.patch
          4 kB
          Edward Ribeiro
        2. KAFKA-2338_2015-07-21_13:21:19.patch
          3 kB
          Edward Ribeiro
        3. KAFKA-2338_2015-08-24_14:32:38.patch
          6 kB
          Edward Ribeiro
        4. KAFKA-2338_2015-09-02_19:27:17.patch
          6 kB
          Edward Ribeiro
        5. KAFKA-2338.patch
          6 kB
          Edward Ribeiro

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            benstopford Ben Stopford
            ewencp Ewen Cheslack-Postava
            Gwen Shapira Gwen Shapira
            Votes:
            0 Vote for this issue
            Watchers:
            5 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment