[SPARK-37574] Simplify fetchBlocks w/o retry

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: Shuffle
• Assignee: Unassigned
• Reporter: Cheng Pan
• Created: 08/Dec/21 04:34
• Updated: 24/Nov/22 00:29

Description

 

if (maxRetries > 0) {
  // Note this Fetcher will correctly handle maxRetries == 0; we avoid it just in case there's
  // a bug in this code. We should remove the if statement once we're sure of the stability.
  new RetryingBlockTransferor(transportConf, blockFetchStarter, blockIds, listener).start()
} else {
  blockFetchStarter.createAndStart(blockIds, listener)
}

 

 

Issue Links

• links to: [Github] Pull Request #34831 (pan3793)
• links to: [Github] Pull Request #34831 (pan3793)