Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21736

Introduce latency tracking state

    XMLWordPrintableJSON

    Details

    • Release Note:
      State access latency metrics are introduced to track all kinds of keyed state access to help debug state performance. This feature is not enabled by default and could be turned on once setting `state.backend.latency-track.keyed-state-enabled` as true.

      Description

      This ticket is extended from FLINK-16444 which wants to track latency of RocksDB options. However previous ticket has two problems:

      1. Cannot apply to heap based state backend and other user customized state backend.
      2. User need background knowledge to know what RocksDB operation corresponding to what state operation, e.g RocksDB adoptsĀ merge to act as listState#add.

      Thus, I prefer to introduce latency tracking state wrapper to detect the access latency. And to not impact the original state access, I would still use sample interval as previousĀ FLINK-16444 did.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                yunta Yun Tang
                Reporter:
                yunta Yun Tang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: