Uploaded image for project: 'Singa'
  1. Singa
  2. SINGA-30

Enhance easy-to-use feature and support concurrent jobs

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None

    Description

      To let users run singa jobs easily and concurrently, we need to enhance the functionalities zookeeper services and bash scripts. There are several milestones:

      1. Automatically launch a number of processes in the cluster
      User only need to provide a global host list that singa can use, instead of providing a host list for each job.

      2. Support running multiple singa jobs at the same time
      We need to ensure that all runtime information is stored in separated zookeeper paths. The first step is to implement a tool that generates a unique job id for each job, and let zookeeper put contents into different paths.

      3. Provide an easy-to-use script for users to run and kill singa jobs, such as:
      $./singa.sh start -conf=CONF_DIR
      $./singa.sh kill -job=JOB_ID

      We will get these done step by step.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            wangsh Wang Sheng
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment