Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14834

Improved processor semantics for versioned stores

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.5.0
    • streams

    Description

      With the introduction of versioned state stores in KIP-889, we should leverage them to provide improved join semantics. 

      As described in KIP-914, we will make the following four improvements:

      • stream-table joins will perform a timestamped lookup (using the stream-side record timestamp) if the table is versioned
      • table-table joins, including foreign key joins, will not produce new join results on out-of-order records (by key) from versioned tables
      • table filters will disable the existing optimization to not send duplicate tombstones when applied to a versioned table
      • table aggregations will ignore out-of-order records when aggregating a versioned table

      Attachments

        Activity

          People

            vcrfxia Victoria Xia
            vcrfxia Victoria Xia
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: