[FLINK-14553] Respect non-blocking output in StreamTask#processInput

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: Runtime / Task
• Labels: pull-request-available
• Assignee: Zhijiang
• Reporter: Zhijiang
• Created: 29/Oct/19 08:17
• Updated: 14/Oct/20 07:25
• Resolved: 17/Nov/19 05:49

Description

The non-blocking output was introduced in FLINK-14396 and FLINK-14498 to solve the problem of handling the checkpoint barrier in the case of backpressure.

In order to make the whole process through, StreamInputProcessor should be allowed to process input elements if the output is also available.

The default core size of LocalBufferPool for ResultPartition should also be increased by 1 in order not to impact the performance in the new way, and this tiny memory overhead could be ignored in practice.

Issue Links

• is blocked by: FLINK-14472 Implement back-pressure monitor with non-blocking outputs
• links to: GitHub Pull Request #10029