[FLINK-24954] Reset read buffer request timeout on buffer recycling for sort-shuffle

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.4, 1.15.0
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Yuxin Tan
• Reporter: Yingjie Cao
• Created: 18/Nov/21 10:25
• Updated: 16/Jan/22 09:01
• Resolved: 16/Jan/22 09:01

Description

Currently, the read buffer request timeout implementation of sort-shuffle is a little aggressive. As reported in the mailing list: https://lists.apache.org/thread/bd3s5bqfg9oxlb1g1gg3pxs3577lhf88. The TimeoutException may be triggered if there is data skew and the downstream task is slow. Actually, we can further improve this case by reseting the request timeout on buffer recycling.

Issue Links

• links to: GitHub Pull Request #17936