Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Job scheduler should support safe mode in case of the HBase cluster change.
In xiaomi, we want update the HBase cluster from hbase0.98 to HBase 2.0. The history data can be migrated previously, but the job has been submitted will keep running and write data to the old cluster. So we need a method to ensure that, job create htable in the old cluster will write data to the old cluster, and the job have not create htable should not be scheduled.
So we need job scheduler safe mode. Open safe mode before changing cluster config, the running jobs can run continuous, and the new job cannot be scheduled.
After all running job finished, we can change the cluster config to the new one, and rest of job can be scheduled again.
