[SPARK-35763] Minor refactor of StateStoreCustomMetric

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.1.2
• Fix Version/s: 3.2.0
• Component/s: Structured Streaming
• Assignee: Venki Korukanti
• Reporter: Venki Korukanti
• Created: 15/Jun/21 06:04
• Updated: 16/Jun/21 22:50
• Resolved: 16/Jun/21 22:50

Description

Code in SymmetricHashJoinStateManager relies on the subclass implementations of StateStoreCustomMetric.

If a new subclass of StateStoreCustomMetric is added, it requires code changes to SymmetricHashJoinStateManager and we may miss the update if there is no existing test coverage.

To fix this, add new method to trait withNewDesc(desc : String) to StateStoreCustomMetric and use it in SymmetricHashJoinStateManager

Issue Links

• links to: [Github] Pull Request #32914 (vkorukanti)