Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31791 FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration
  3. FLINK-32053

Introduce StateMetadata to ExecNode to support configure operator-level state TTL via CompiledPlan

    XMLWordPrintableJSON

Details

    Description

      This subtask should introduce StateMetadata to all ExecNodes that translate to stateful operators, changing the way how `#translateToPlanInternal` get the state retention time. The affected `ExecNode` list

          StreamExecChangelogNormalize
          StreamExecDeduplicate
          StreamExecGlobalGroupAggregate
          StreamExecGroupAggregate
          StreamExecIncrementalGroupAggregate
          StreamExecJoin
          StreamExecLimit
          StreamExecLookupJoin
          StreamExecRank
          StreamExecSink
          StreamExecSortLimit
      

      Since we have upgraded some `ExecNode`s to version 2, we have to test the following 3 parts:
      1. the plans serialized using version 1 can be deserialized using the current version.
      2. the plans with the current version SerDe work as expected.
      3. The way by modifying the JSON content to change state TTL works as expected.

      Attachments

        Activity

          People

            qingyue Jane Chan
            qingyue Jane Chan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: