Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4815 Idempotent/transactional Producer (KIP-98)
  3. KAFKA-5017

Consider making baseOffset the first offset in message format v2

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • clients, core, producer
    • None

    Description

      Currently baseOffset starts as the first offset of the batch. If the first record is removed by compaction, baseOffset doesn't change and it is no longer the same as the first offset of the batch. This is inconsistent with every other field in the record batch header and it seems like there is no longer a reason for this behaviour.

      We should consider simplifying the behaviour so that baseOffset is simply the first offset of the record batch. We need to do this before 0.11 or we probably won't be able to do it until the next message format version change.

      cc hachikuji

      Attachments

        Issue Links

          Activity

            People

              hachikuji Jason Gustafson
              ijuma Ismael Juma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: