Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Duplicate
-
1.3.1
-
None
Description
It appears Flink can't measure the number of bytes read or records produced by a source (e.g. Kafka source). This is particularly problematic for simple jobs where the job pipeline is chained, and in which there are no measurements between operators. Thus, in the UI it appears that the job is not consuming any data.
Attachments
Issue Links
- is blocked by
-
FLINK-9050 Expose operator IO counter metrics
- Resolved
-
FLINK-10740 FLIP-27: Refactor Source Interface
- Open
- is related to
-
FLINK-11576 FLIP-33: Standardize connector metrics
- Resolved
- relates to
-
FLINK-10707 Improve Cluster Overview in Flink Dashboard
- Closed
-
FLINK-33681 Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
- Resolved