[SUBMARINE-258] [SS]Add k8s job submitter in submarine server to run TF job on k8s

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: K8s Submitter
• Target Version: 0.3.0
• Assignee: Wanqiang Ji
• Reporter: Zhankun Tang
• Created: 23/Oct/19 06:12
• Updated: 16/Dec/19 15:53
• Resolved: 16/Dec/19 15:53

Description

As a PoC, we need several below steps to run the TF job on k8s.

1. The submarine server can run as an independent daemon
2. tf-operator deployed in a k8s cluster. Use kubeflow/tf-operator for now
3. REST API in submarine server to accept a generic TF job spec
4. submitter-k8s translate the spec into tf-operator format and use k8s client API to submit this to the cluster
5. REST API to get tf job status from k8s and parse it to a standard format to be consumed

Issue Links

• is a parent of: SUBMARINE-214 [WIP] Add submitter-k8s module
• is duplicated by: SUBMARINE-214 [WIP] Add submitter-k8s module