[SPARK-36484] Handle Stale block fetch failure on the client side by not retrying the requests

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 3.2.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Venkata krishnan Sowrirajan
• Created: 12/Aug/21 00:33
• Updated: 16/Aug/21 16:45
• Resolved: 16/Aug/21 16:45

Description

Similar to SPARK-36378, we need to handle the stale block fetch failures on the client side, although without handling it there won't be any correctness issues. This would help in saving some server side bandwidth unnecessarily serving stale shuffle fetch requests.