Kafka
  1. Kafka
  2. KAFKA-274

Handle corrupted messages cleanly

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7
    • Fix Version/s: 0.7.1
    • Component/s: core
    • Labels:
      None

      Description

      This is related to KAFKA-273 and is filed to improve the code to have more defensive checks against corrupted data. The data could get corrupted either due to a Kafka bug or due to bit flipping on the network. The message iterator should check if the message is valid before trying to decompress it. On the producer side, defensive checks can be turned on to verify the messages before writing those to the socket.

      1. KAFKA-274_v2.patch
        4 kB
        Neha Narkhede
      2. KAFKA-274.patch
        4 kB
        Neha Narkhede

        Issue Links

          Activity

          Hide
          Neha Narkhede added a comment -

          Guarded against message set sizes > Int.MaxValue

          Show
          Neha Narkhede added a comment - Guarded against message set sizes > Int.MaxValue
          Hide
          Jun Rao added a comment -

          +1 for the patch.

          Show
          Jun Rao added a comment - +1 for the patch.

            People

            • Assignee:
              Neha Narkhede
              Reporter:
              Neha Narkhede
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development