[FLINK-15438] Counter metrics are incorrectly reported as total counts to DataDog

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.9.1
• Fix Version/s: 1.11.0
• Component/s: Runtime / Metrics
• Labels: pull-request-available
• Release Note: The DataDog metrics reporter now reports counts as the number of events over the reporting interval, instead of the total count. This aligns the count semantics with the DataDog documentation.
• Assignee: Jörn Kottmann
• Reporter: Jörn Kottmann
• Created: 30/Dec/19 13:41
• Updated: 26/Mar/20 09:54
• Resolved: 26/Mar/20 09:54

Description

The Flink semantics of a counter are not matching with the counters in DataDog.

In Flink a counter counts the total of increment and decrement calls.
In DataDog a counter is a rate over the reporting interval.

The Flink implementation of the DataDog reporter seems to send the Flink counter value each time the metrics are reported. Correct would be to send the delta of the counter since the last report.

There are some features in DataDog which are easier to use if this could be fixed, e.g. alerts based on counters.

Issue Links

• links to: GitHub Pull Request #11483