Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6530

Use actual first offset of messages when rolling log segment for magic v2

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      We've implemented a heuristic to avoid overflowing when rolling a log segment to determine the base offset of the next segment without decompressing the message set to find the actual first offset. With the v2 message format, we can find the first offset without needing decompression, so we can set the correct base offset exactly.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dhruvilshah Dhruvil Shah
                Reporter:
                hachikuji Jason Gustafson
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: