Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
To let users run singa jobs easily and concurrently, we need to enhance the functionalities zookeeper services and bash scripts. There are several milestones:
1. Automatically launch a number of processes in the cluster
User only need to provide a global host list that singa can use, instead of providing a host list for each job.
2. Support running multiple singa jobs at the same time
We need to ensure that all runtime information is stored in separated zookeeper paths. The first step is to implement a tool that generates a unique job id for each job, and let zookeeper put contents into different paths.
3. Provide an easy-to-use script for users to run and kill singa jobs, such as:
$./singa.sh start -conf=CONF_DIR
$./singa.sh kill -job=JOB_ID
We will get these done step by step.