Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-29231

PyFlink UDAF produces different results in the same sliding window

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      It seems that PyFlink udtaf produces different results in the same sliding window. It can be reproduced with the given code and input. It is not always happening but the possibility is relatively high.

      The incorrect output is the following:

       

      We can see that the output contains different `val_sum` at `window_time` 2022-01-01 00:01:59.999.

      Attachments

        1. image-2022-09-08-17-20-06-296.png
          68 kB
          Xuannan Su
        2. input
          0.2 kB
          Xuannan Su
        3. test_agg.py
          3 kB
          Xuannan Su

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            dianfu Dian Fu
            xuannan Xuannan Su
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment