[FLINK-1241] Record processing counter for Dashboard

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 0.8.0
• Component/s: Runtime / Web Frontend
• Labels: counters dashboard monitoring web-console

Environment

Mozilla Firefox 33.0 for Ubuntu Canonical. Ubuntu 14.04 LTS

• Assignee: Unassigned
• Reporter: Stefano Bortoli
• Created: 13/Nov/14 15:49
• Updated: 11/Jan/16 23:08
• Resolved: 11/Jan/16 23:08

Description

It would be great to have a detail of the record processed by each of the split in the dashboard. If computing exact processing time is impossible, knowing the number of records would allow to estimate it roughly at least. (hours VS days, for example). It would also help to understand whether there is something odd going on as processing either perceived as too slow or too fast.

There are issues related to this improvements: FLINK-964, FLINK-766.

Furthermore, there is also an old GSoC proposal, which is related https://github.com/stratosphere/stratosphere/wiki/GSoC-2014-Project-Proposal-Draft-by-Rajika-Kumarasiri