[CELEBORN-1602] do hard split for push merged data RPC with disk full

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0, 0.5.2
• Labels: pull-request-available
• Assignee: Erik.fang
• Reporter: Erik.fang
• Created: 20/Sep/24 03:21
• Updated: 20/Sep/24 07:25
• Resolved: 20/Sep/24 06:43

Description

In our cluster, disk space of celeborn worker is sometimes written to 100%, and we found that PushDataHandler doesn't check disk space during processing of push merged data PRC. hard split should be returned in this case

Issue Links

• links to: GitHub Pull Request #2747