[SPARK-24021] Fix bug in BlacklistTracker's updateBlacklistForFetchFailure

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.1, 2.4.0
• Component/s: Spark Core
• Labels: easyfix
• Flags: Important
• Assignee: wuyi
• Reporter: wuyi
• Created: 19/Apr/18 02:41
• Updated: 19/Apr/18 14:01
• Resolved: 19/Apr/18 14:01

Description

There's a miswrite in BlacklistTracker's updateBlacklistForFetchFailure:

 

val blacklistedExecsOnNode =
    nodeToBlacklistedExecs.getOrElseUpdate(exec, HashSet[String]())
blacklistedExecsOnNode += exec

 

where first exec should be host.

Issue Links

• links to: [Github] Pull Request #21104 (Ngone51)