[FLINK-16611] Datadog reporter should chunk large reports

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.11.0
• Component/s: Runtime / Metrics
• Labels: pull-request-available
• Assignee: Stephen Whelan
• Reporter: Chesnay Schepler
• Created: 16/Mar/20 09:49
• Updated: 16/Oct/20 10:52
• Resolved: 20/May/20 09:33

Description

Datadog has a maximum size for reports that it accepts.

If the report exceeds this size it is simply rejected, rendering the reporter unusable.

We should investigate what this size limit is, and split the report into multiple chunks.

Issue Links

• links to: GitHub Pull Request #12138