Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9583

OffsetsForLeaderEpoch requests are sometimes not sent to the leader of partition

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      In validateOffsetsAsync, we group the requests by leader node for efficiency. The list of topic-partitions are grouped from partitionsToValidate (all partitions) to node => fetchPostitions (partitions by node).

      However, when actually sending the request with OffsetsForLeaderEpochClient, we use partitionsToValidate, which is the list of all topic-partitions passed into validateOffsetsAsync. This results in extra partitions being included in the request sent to brokers that are potentially not the leader for those partitions.

      I have submitted a PR, https://github.com/apache/kafka/pull/8077, that fixes this issue.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            andyfangdz Andy Fang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment