Description
Kafka Streams allows to create iterators over state stores. Those iterator must get closed to free up resources (especially for RocksDB). – We regularly get user reports of "resource leaks" that can be pinned down to leaking (ie not-closed) iterators.
To simplify monitoring, it would be helpful to add a metric about open iterators to allow users to alert and pin-point the issue directly (and before the actually resource leak is observed).
We might want to have a DEBUG level per-store metric (to allow identifying the store in question quickly), but an already rolled up INFO level metric for the whole application.
Attachments
Issue Links
- is duplicated by
-
KAFKA-15541 Improved StateStore Iterator metrics for detecting leaks
-
- Resolved
-