Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-13264

backwardFetch in InMemoryWindowStore doesn't return in reverse order

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0
    • 3.1.0
    • streams
    • None

    Description

      When working on another PR, I found currently, the backwardFetch in InMemoryWindowStore doesn't return in reverse order when there are records in the same window.

      ex: window size = 500,

      input records:

      key: "a", value: "aa", timestamp: 0 ==> will be in [0, 500] window

      key: "b", value: "bb", timestamp: 10 ==> will be in [0, 500] window

       

      So, internally, the "a" and "b" will be in the same segment.

      when fetch in forward order:

      "a" -> "b", which is expected

      when fetch in backward order:

      "a" -> "b", which is NOT expected (because we didn't make the segment iterator as descendingMap)

      Attachments

        Issue Links

          Activity

            People

              showuon Luke Chen
              showuon Luke Chen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: