Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4178

Job scheduler support safe mode

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v3.0.0
    • Component/s: None
    • Labels:
      None

      Description

      Job scheduler should support safe mode in case of the HBase cluster change.

      In xiaomi, we want update the HBase cluster from hbase0.98 to HBase 2.0. The history data can be migrated previously, but the job has been submitted will keep running and write data to the old cluster. So we need a method to ensure that, job create htable in the old cluster will write data to the old cluster, and the job have not create htable should not be scheduled.

      So we need  job scheduler safe mode. Open safe mode before changing cluster config,  the  running jobs can run continuous, and the new job cannot be scheduled. 

      After all running job finished, we can change the cluster config to the new one,  and rest of job can be scheduled again.

       

        Attachments

        1. image-2019-11-26-18-42-33-473.png
          395 kB
          Yaqian Zhang

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              zhoukangcn ZhouKang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: