[SPARK-40807] "RocksDB: commit - pause bg time total" metric always 0

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: Structured Streaming
• Assignee: Unassigned
• Reporter: Jacek Laskowski
• Created: 15/Oct/22 18:23
• Updated: 15/Oct/22 18:25

Description

RocksDBStateStore uses pauseBg key to report "RocksDB: commit - pause bg time" metric while RocksDB uses pause to provide a value every commit. That leads to a name mismatch and 0 reported (as the default value for no metrics).