Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4609

KTable/KTable join followed by groupBy and aggregate/count can result in duplicated results

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.10.1.1, 0.10.2.0
    • Fix Version/s: None
    • Component/s: streams
    • Labels:

      Description

      When caching is enabled, KTable/KTable joins can result in duplicate values being emitted. This will occur if there were updates to the same key in both tables. Each table is flushed independently, and each table will trigger the join, so you get two results for the same key.
      If we subsequently perform a groupBy and then aggregate operation we will now process these duplicates resulting in incorrect aggregated values. For example count will be double the value it should be.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              damianguy Damian Guy
            • Votes:
              2 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated: