[SPARK-21500] Update Shuffle Fetch bookkeeping immediately after receiving remote block

• Type: Task
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.2.0
• Component/s: Shuffle, Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Dhruve Ashar
• Created: 21/Jul/17 15:36
• Updated: 21/May/19 04:13
• Resolved: 21/May/19 04:13

Description

Currently we update any remote shuffle fetch related parameters only when we start processing the FetchResult rather than updating them immediately after receiving them. This would speed up sending requests for remote shuffle fetch.