[FLINK-9652] Metrics for upstream and downstream

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Runtime / Metrics
• Labels: auto-deprioritized-major auto-deprioritized-minor metrics sink source
• Assignee: Unassigned
• Reporter: Godfrey He
• Created: 24/Jun/18 11:46
• Updated: 07/Dec/21 10:40

Description

Flink can get metrics from source to the next operators，but can not get the total input/output metrics from web UI, which is inconvenient for user to get the records  status for job.

1. Upstream and downstream metrics is import for troubleshooting.
2. No source input metrics,  making many users considered that no kafka input at all, and Flink or Flink program might have some error. The same problem for the sink output metrics.
3. For some one operator job(just source and sink in the same operator chain), user cannot see any stream metrics, unless adds an keyBy operation, which will print the source output metrics.