[FLINK-20571] Add dynamic open/close LatencyMarksEmitter to support online debug and monitoring

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: API / DataStream
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: zlzhang0122
• Created: 11/Dec/20 05:53
• Updated: 07/Nov/21 22:38

Description

Now, flink has provided latency metrics to monitor the latency, but this function mainly used in debugging contexts rather than in production contexts because of throughput effect. If we provider an api that can dynamic open/close this function, then we can monitor the online data latency and find out the performance bottleneck in time without restart the job, which maybe helpful for online debug.