Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15938

Idle state not cleaned in StreamingJoinOperator and StreamingSemiAntiJoinOperator

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      return StateTtlConfig
         .newBuilder(Time.milliseconds(retentionTime))
         .setUpdateType(StateTtlConfig.UpdateType.OnCreateAndWrite)
         .setStateVisibility(StateTtlConfig.StateVisibility.ReturnExpiredIfNotCleanedUp)
         .build();
      

      StateTtl is constructed in above code for `StreamingJoinOperator` and `StreamingSemiAntiJoinOperator`.

      However, as stated in https://ci.apache.org/projects/flink/flink-docs-master/dev/stream/state/state.html#cleanup-of-expired-state , the state will be cleaned only when it's read which means the state will not be cleaned enless we read it.

        Attachments

          Activity

            People

            • Assignee:
              libenchao Benchao Li
              Reporter:
              libenchao Benchao Li

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                  Issue deployment