[FLINK-33452] A series of improvements of Autoscaler Standalone

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: Autoscaler
• Assignee: Rui Fan
• Reporter: Rui Fan
• Created: 03/Nov/23 13:56
• Updated: 08/Jan/24 11:03

Description

This is an umbrella ticket. It aims to make a series of improvements to the Autoscaler Standalone to bring it into production.

Sub-Tasks

• Refactor the configuration for autoscaler standalone: Resolved
• Autoscaler Standalone control loop supports multiple thread: Resolved
• Implement JdbcAutoScalerStateStore: Resolved
• Implement JdbcAutoScalerEventHandler: Resolved
• Print jobKey in the Autoscaler standalone log: Resolved
• Using the flink shaded jackson for flink-autoscaler: Resolved
• Implement YarnJobFetcher for Standalone Autoscaler: Open
• Standalone autoscaler supports the metric reporter: Open
• Add the integration test for standalone autoscaler: Open
• Design AbstractAutoscalerStateStore to support serialize State to String: In Progress
• Autoscaler Standalone should clean up stopped jobs to prevent memory leaks: Resolved
• Support setting default Autoscaler options at autoscaler standalone level: Resolved