Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5075

Defer exception to the next pollOnce() if consumer's fetch position has already increased

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.2.0
    • 0.10.2.1, 0.11.0.0
    • clients, consumer
    • None

    Description

      In Fetcher.fetchRecords() we iterate over the partition data to collect the ConsumerRecords, after we collect some consumer records from a partition, we advance the position of that partition then move on to the next partition. If the next partition throws exceptions (e.g. OffsetOutOfRangeException), the messages that have already been read out of the buffer will not be delivered to the users. Since the positions of the previous partitions have been be updated, those messages will not be consumed again either.

      Attachments

        Issue Links

          Activity

            People

              lindong Dong Lin
              becket_qin Jiangjie Qin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: