Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5211

KafkaConsumer should not skip a corrupted record after throwing an exception.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0.0
    • Component/s: None
    • Labels:

      Description

      In 0.10.2, when there is a corrupted record, KafkaConsumer.poll() will throw an exception and block on that corrupted record. In the latest trunk this behavior has changed to skip the corrupted record (which is the old consumer behavior). With KIP-98, skipping corrupted messages would be a little dangerous as the message could be a control message for a transaction. We should fix the issue to let the KafkaConsumer block on the corrupted messages.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                becket_qin Jiangjie Qin
                Reporter:
                becket_qin Jiangjie Qin
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: