Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33852 FLIP-403 High Availability Services for OLAP Scenarios
  3. FLINK-32667

Enable users to independently adjust the high availability strategies related to jobs through configuration

    XMLWordPrintableJSON

Details

    Description

      In OLAP scenarios, we only require the leader election services for the Dispatcher / ResourceManager and RestEndpoint in the JobManager process. Leader election services and persistent services are redundant for jobs and may impact cluster performance.
      To generate HA services suitable for OLAP scenarios, we introduce the high-availability.enable-job-recovery parameter. When users enable HA with Kubernetes or ZooKeeper and set this option to false, we will select the combination of DefaultLeaderServices and EmbeddedPersistentServices. Additionally, we will set the JobMaster's LeaderElectionService and LeaderRetrieverService to the Standalone version.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue FLINK-33033 Add haservice micro benchmark for olap

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #23101

          Web Link GitHub Pull Request #23904

          Activity

            People

              guoyangze Yangze Guo
              zjureel Fang Yong
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: