[FLINK-10969] expose API or metric for total number of keys stored in state backend

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: Runtime / Metrics, Runtime / State Backends
• Assignee: vinoyang
• Reporter: Steven Zhen Wu
• Created: 21/Nov/18 21:22
• Updated: 22/Nov/18 09:19
• Resolved: 22/Nov/18 09:19

Description

srichter mentioned it might make sense to provide two versions: exact count and approximate count. For some state backend (likes rocksDB), it may be much cheaper to get approximate count.

exposing as metrics would be ideal.

Additionally, it will also be useful to get the total count of timers, which are also stored in state backend. Stefan mentioned timers are just a different namespace in state backend (e.g. column family in rocksDB). So it will be very useful if the metrics have namespace tag.

Issue Links

• duplicates: FLINK-10452 Expose Additional Metrics to Reason about Statesize