Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4887

Enabling caching on a persistent window store breaks support for duplicate insertion

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.2.0
    • Fix Version/s: None
    • Component/s: streams
    • Labels:
      None

      Description

      CachingWindowStore and RocksDBWindowStore interact badly when duplicate insertion support is enabled by passing true as the fourth argument to windowed in the state store supplier.

      When the feature is enabled, RocksDBWindowStore correct handles duplicates by assigning a unique sequence number to each element on insertion and using the number within the key.

      When caching is enabled by calling enableCaching on the supplier, CachingWindowStore fails to the the same. Thus, of multiple values inserted with the same key, only the last one survives.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                elevy Elias Levy
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: