[YARN-426] Failure to download a public resource on a node prevents further downloads of the resource from that node

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha, 0.23.6
• Fix Version/s: 0.23.7, 2.1.0-beta
• Component/s: nodemanager
• Target Version/s: 0.23.7, 2.1.0-beta
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 25/Feb/13 20:07
• Updated: 03/Sep/14 22:54
• Resolved: 27/Feb/13 15:35

Description

If the NM encounters an error while downloading a public resource, it fails to empty the list of request events corresponding to the resource request in attempts. If the same public resource is subsequently requested on that node, PublicLocalizer.addResource will skip the download since it will mistakenly believe a download of that resource is already in progress. At that point any container that requests the public resource will just hang in the LOCALIZING state.