Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7895

Ktable supress operator emitting more than one record for the same key per window

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.1.0, 2.2.0, 2.1.1
    • Fix Version/s: 2.3.0, 2.1.2, 2.2.1
    • Component/s: streams
    • Labels:
      None

      Description

      Hi, We are using kstreams to get the aggregated counts per vendor(key) within a specified window.

      Here's how we configured the suppress operator to emit one final record per key/window.

      KTable<Windowed<Integer>, Long> windowedCount = groupedStream
           .windowedBy(TimeWindows.of(Duration.ofMinutes(1)).grace(ofMillis(5L)))
           .count(Materialized.with(Serdes.Integer(),Serdes.Long()))
           .suppress(Suppressed.untilWindowCloses(unbounded()));
      

      But we are getting more than one record for the same key/window as shown below.

      [KTABLE-TOSTREAM-0000000010]: [131@1549067040000/1549067100000], 1039
      [KTABLE-TOSTREAM-0000000010]: [131@1549067040000/1549067100000], 1162
      [KTABLE-TOSTREAM-0000000010]: [9@1549067040000/1549067100000], 6584
      [KTABLE-TOSTREAM-0000000010]: [88@1549067040000/1549067100000], 107
      [KTABLE-TOSTREAM-0000000010]: [108@1549067040000/1549067100000], 315
      [KTABLE-TOSTREAM-0000000010]: [119@1549067040000/1549067100000], 119
      [KTABLE-TOSTREAM-0000000010]: [154@1549067040000/1549067100000], 746
      [KTABLE-TOSTREAM-0000000010]: [154@1549067040000/1549067100000], 809

      Could you please take a look?

      Thanks

       

       

      Added by John:

      Acceptance Criteria:

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vvcephei John Roesler
                Reporter:
                prasanthi13 prasanthi
                Reviewer:
                John Roesler
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: