[FLINK-15030] Potential deadlock for bounded blocking ResultPartition.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0, 1.9.1
• Fix Version/s: 1.9.2
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Yingjie Cao
• Reporter: Yingjie Cao
• Created: 03/Dec/19 07:14
• Updated: 14/Dec/19 16:45
• Resolved: 14/Dec/19 16:45

Description

Currently, the BoundedBlockingSubpartition relies on the add of the next BufferConsumer to flush and recycle the previous one, which means we need at least (numsubpartition + 1) buffers to make the bounded blocking ResultPartition work. However, the ResultPartitionFactory gives only (numsubpartition) required buffers to the BoundedBlockingSubpartition which may lead to deadlock.

This problem exists only in version 1.9. In version 1.10 (master), this problem has been fixed by this commit: 2c8b4ef572f05bf4740b7e204af1e5e709cd945c.

Issue Links

• links to: GitHub Pull Request #10395