[SUBMARINE-15] [Submarine] Job should not be submitted if "--input_path" option is missing

• Type: New Feature
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.2.0
• Assignee: Zhankun Tang
• Reporter: Zhankun Tang
• Created: 19/Sep/18 15:12
• Updated: 23/Sep/19 02:41
• Resolved: 16/Oct/18 21:36

Description

If a user doesn't set "–input_path" option, the job will still be submitted. Here is my command to run the job:

yarn jar $HADOOP_BASE_DIR/home/share/hadoop/yarn/hadoop-yarn-submarine-3.2.0-SNAPSHOT.jar job run \
 -verbose \
 -wait_job_finish \
 --env DOCKER_JAVA_HOME=/usr/lib/jvm/java-8-oracle \
 --env DOCKER_HADOOP_HDFS_HOME=/hadoop-3.2.0-SNAPSHOT \
 --name tf-job-001 \
 --docker_image tangzhankun/tensorflow \
 --worker_resources memory=4G,vcores=2 \
 --worker_launch_cmd "cd /cifar10_estimator && python cifar10_main.py --data-dir=%input_path% --job-dir=%checkpoint_path% --num-gpus=0 --train-steps=5"

Due to lack of invalidity check, the job is still submitted. We should add a check on this.