Details
-
Sub-task
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
1.18.0
-
None
Description
In OLAP scenarios, we only require the leader election services for the Dispatcher / ResourceManager and RestEndpoint in the JobManager process. Leader election services and persistent services are redundant for jobs and may impact cluster performance.
To generate HA services suitable for OLAP scenarios, we introduce the high-availability.enable-job-recovery parameter. When users enable HA with Kubernetes or ZooKeeper and set this option to false, we will select the combination of DefaultLeaderServices and EmbeddedPersistentServices. Additionally, we will set the JobMaster's LeaderElectionService and LeaderRetrieverService to the Standalone version.
Attachments
Issue Links
- relates to
-
FLINK-33033 Add haservice micro benchmark for olap
- Closed
- links to