[FLINK-29923] Hybrid Shuffle may face deadlock when running a task need to execute big size data

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.16.0
• Fix Version/s: 1.17.0, 1.16.1
• Component/s: Runtime / Network
• Assignee: Unassigned
• Reporter: AlexHu
• Created: 08/Nov/22 04:03
• Updated: 13/Dec/22 04:32
• Resolved: 13/Dec/22 04:32

Description

The flink 1.16 offers hybrid shuffle to combine the superiority of blocking shuffle and pipeline shuffle. But when I want to test this new feature I face a problem that it may cause deadlock when it running. 

Actually, it will run well at beginning. However, when it runs to a certain number it may failure for the buffer size and if I set a bigger size it may running without data execution like the picture. So I want to ask the cause of this problem and a solution.

Issue Links

• is caused by: FLINK-29298 LocalBufferPool request buffer from NetworkBufferPool hanging