[SUBMARINE-214] [WIP] Add submitter-k8s module

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: Backend Server
• Labels: pull-request-available
• Assignee: Wanqiang Ji
• Reporter: Wanqiang Ji
• Created: 05/Oct/19 04:11
• Updated: 16/Dec/19 15:53
• Resolved: 11/Nov/19 02:39

Description

As a PoC, we need several below steps to run the TF job on k8s.

1. The submarine server can run as an independent daemon
2. tf-operator deployed in a K8s cluster. Use kubeflow/tf-operator for now
3. REST API in submarine server to accept a generic TF job spec
4. submitter-k8s translate the spec into tf-operator format and use k8s client API to submit this to the cluster
5. REST API to get tf job status from k8s and parse it to a standard format to be consumed

Add the submitter-k8s module implements the CRUD for custom resource objects, includes the UTs. Before run the UTs, you should deploy the tf-operator in a K8s cluster and replace the config at the test resources.

Issue Links

• duplicates: SUBMARINE-258 [SS]Add k8s job submitter in submarine server to run TF job on k8s
• is a child of: SUBMARINE-258 [SS]Add k8s job submitter in submarine server to run TF job on k8s
• links to: GitHub Pull Request #79