[FLINK-10150] Chained batch operators interfere with each other other

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0, 1.5.0, 1.6.0, 1.7.0
• Fix Version/s: 1.5.4, 1.6.1, 1.7.0
• Component/s: Runtime / Metrics, Runtime / Web Frontend
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Helmut Zechmann
• Created: 15/Aug/18 13:06
• Updated: 25/Oct/18 09:07
• Resolved: 05/Sep/18 08:04

Description

The flink web ui displays an inconsistent number of "Records received" / "Records sent” in the job overview "Subtasks" view.

When I run the example wordcount batch job with a small input file on flink 1.3.2 I get

• 3 records sent by the first subtask and
• 3 records received by the second subtask

This is the result I would expect.

If I run the same job on flink 1.4.0 / 1.5.2 / 1.6.0 I get

• 13 records sent by the first subtask and
• 3 records received by the second subtask

In real life jobs the numbers are much more strange.

Issue Links

• is duplicated by: FLINK-10300 Prometheus job level metrics not removed after job finished
• links to: GitHub Pull Request #6599
• links to: GitHub Pull Request #6654
• links to: GitHub Pull Request #6655