Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15938

Idle state not cleaned in StreamingJoinOperator and StreamingSemiAntiJoinOperator

    XMLWordPrintableJSON

    Details

      Description

      return StateTtlConfig
         .newBuilder(Time.milliseconds(retentionTime))
         .setUpdateType(StateTtlConfig.UpdateType.OnCreateAndWrite)
         .setStateVisibility(StateTtlConfig.StateVisibility.ReturnExpiredIfNotCleanedUp)
         .build();
      

      StateTtl is constructed in above code for `StreamingJoinOperator` and `StreamingSemiAntiJoinOperator`.

      However, as stated in https://ci.apache.org/projects/flink/flink-docs-master/dev/stream/state/state.html#cleanup-of-expired-state , the state will be cleaned only when it's read which means the state will not be cleaned enless we read it.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                libenchao Benchao Li
                Reporter:
                libenchao Benchao Li
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m