[REEF-1419] Job status and metrics reporting in IMRU

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF.NET

Environment

C#

• Assignee: Unassigned
• Reporter: Dhruv Mahajan
• Created: 04/Jun/16 17:53
• Updated: 22/Jun/16 19:32

Description

Currently, when any external application uses IMRU client to start an IMRU job, there is no way to register and get a Job status back periodically.

First of all, the job status needs to be communicated from evaluators to driver and then driver needs to communicate it back to client.

The aim of this JIRA is to discuss and converge on possible solution and then implement it.

Issue Links

• is related to: MAHOUT-1869 Create a runtime performance measuring framework for mahout

Sub-Tasks

• Develop distributed counters framework in REEF: Open
• Incorporate distributed counters in IMRU framework.: Open
• Driver should be enabled to write status logs in addition to sending it to client: Open
• Develop basic metrics APIs for REEF.Net: Resolved
• Create a separate project for metrics in REEF.Net codebase: Closed
• Develop library of basic mutable Metrics and helper classes: Resolved