Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-22075

Incorrect null outputs in left join

    XMLWordPrintableJSON

Details

    • Bug
    • Status: In Progress
    • Not a Priority
    • Resolution: Unresolved
    • 1.12.2
    • None
    • Table SQL / API

    Description

      I'm left joining a table with itself [here](https://github.com/jamii/streaming-consistency/blob/4e5d144dacf85e512bdc7afd77d031b5974d733e/flink/src/main/java/Demo.java#L55-L66). The output should have no nulls, or at least emit nulls and then retract them. Instead I see:

      ```
      jamie@machine:~/streaming-consistency/flink$ wc -l tmp/outer_join_with_time
      100000 tmp/outer_join_with_time
      jamie@machine:~/streaming-consistency/flink$ grep -c insert tmp/outer_join_with_time
      100000
      jamie@machine:~/streaming-consistency/flink$ grep -c 'null' tmp/outer_join_with_time
      16943
      ```

      ~1.7% of the outputs are incorrect and never retracted.

      [Full output](https://gist.githubusercontent.com/jamii/983fee41609b1425fe7fa59d3249b249/raw/069b9dcd4faf9f6113114381bc7028c6642ca787/gistfile1.txt)

      Attachments

        Activity

          People

            Unassigned Unassigned
            jamii Jamie Brandon
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: