[FLINK-33527] Clear all physical states after autoscaler is disabled

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: kubernetes-operator-1.7.0
• Component/s: Autoscaler
• Labels: pull-request-available
• Assignee: Rui Fan
• Reporter: Rui Fan
• Created: 12/Nov/23 14:03
• Updated: 15/Nov/23 14:55
• Resolved: 13/Nov/23 03:45

Description

Currently, we just clear ParallelismOverrides  after autoscaler is disabled.

We should clear CollectedMetrics and ScalingHistory  as well to prevent state leak.

• CollectedMetrics can be cleared directly.
• ScalingHistory can be cleared based on trim logic( VERTEX_SCALING_HISTORY_AGE)

Issue Links

• links to: GitHub Pull Request #707
• links to: GitHub Pull Request #710