[FLINK-16736] Expose Elasticsearch sink metric

• Type: Improvement
• Status: Reopened
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Connectors / ElasticSearch
• Assignee: Unassigned
• Reporter: YangLee
• Created: 24/Mar/20 04:14
• Updated: 29/Jul/21 07:37

Description

I found it quite useful to expose metric of sink operator via flink metric system for debugging and monitoring purpose, such as:

• total times of bulk request
• total size(sum) of bulk request
• total duration(sum) spent on bulk request

with these metrics, we could derive the average size and duration.

Elasticsearch SDK already exposed all these information by BulkProcessorListenr. A simple bridge should be enough.