Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5533

Timestamp-based log compaction

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.11.0.0
    • None
    • core

    Description

      Today log compaction is based on offsets, not timestamps. That means that a late arriving record with a small timestamp TS can over-write a record with a larger timestamp TL. This affects computations that depend on correct processing of timestamps. For example, in the streams library, this would mean that processing for KTables with late arriving data would not be correct.

      This JIRA will require a KIP.

      Attachments

        Activity

          People

            Unassigned Unassigned
            enothereska Eno Thereska
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: