[SUBMARINE-148] [Umbrella] Submarine-sdk tracking - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: SDK
Labels:
None

Description

The submarine-sdk support Python, Scala, R language for algorithm development, The SDK is provided to help developers use submarine's internal data caching, data exchange, and task tracking to more efficiently improve the development and execution of machine learning tasks.

pysubmarine tracking module is a python API for logging parameters, code versions, metrics

1. Add the sumbrine-sdk/pysubmarine module.
2. pysubmarine supports mysql/HDFS in two ways to store metric data. Priority to do mysql, in order to performance requires python to directly write mysql data, do not take the submarine-sever RESTful interface.
3. Add metric, param instance to the submarine-server database and rest
4. Add Metric tracking ui to submarine-web
5. Add a metric graphical display to submarine-web