[FLINK-14044] Reducing synchronization in AsyncWaitOperator

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: Runtime / Task
• Labels: pull-request-available
• Assignee: Arvid Heise
• Reporter: Arvid Heise
• Created: 10/Sep/19 14:57
• Updated: 22/Jun/21 14:07
• Resolved: 07/Oct/19 07:26

Description

Currently, AsyncWaitOperator receives computed results from a user thread and puts it in StreamElementQueue. This queue is synchronized as the emitter thread pulls available elements in a blocking fashion. With the recent migration to mailbox model, these elements are then put into a letter to be outputted in the mailbox thread.

If we directly send the results from the user thread to the mailbox, we can get rid of any synchronization as everything happens in the user thread. That will slim down the code heavily.

Issue Links

• causes: FLINK-22438 add numRecordsOut metric for Async IO
• links to: GitHub Pull Request #9717