[FLINK-9899] Add more metrics to the Kinesis source connector

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.2, 1.5.1
• Fix Version/s: 1.6.1, 1.7.0
• Component/s: Connectors / Kinesis
• Labels: pull-request-available
• Assignee: Lakshmi Rao
• Reporter: Lakshmi Rao
• Created: 19/Jul/18 22:28
• Updated: 17/Aug/18 05:27
• Resolved: 17/Aug/18 05:27

Description

Currently there are sparse metrics available for the Kinesis Connector. Using the ShardMetricsReporter add more stats. For example:

• sleepTimeMillis
• maxNumberOfRecordsPerFetch
• numberOfAggregatedRecordsPerFetch
• numberOfDeaggregatedRecordsPerFetch
• bytesPerFetch
• averageRecordSizeBytes
• runLoopTimeNanos
• loopFrequencyHz

Issue Links

• links to: GitHub Pull Request #6409
• links to: GitHub Pull Request #6409