Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4937

Batch resetting offsets in Streams' StoreChangelogReader

    XMLWordPrintableJSON

Details

    Description

      Currently in StoreChangelogReader we are calling consumer.position() when logging as well as setting starting offset right after seekingToBeginning, which will incur a blocking round trip with offset request. We should consider batching those in a single round trip for all partitions that needs to seek to beginning (i.e. needs to reset offset).

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-4221 KafkaConsumer Fetcher can send ListOffsets requests in parallel when initializing position

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #2769

          Activity

            People

              damianguy Damian Guy
              guozhang Guozhang Wang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: