[YARN-11467] RM failover may fail when the nodes.exclude-path file does not exist

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: resourcemanager
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: dzcxzl
• Reporter: dzcxzl
• Created: 18/Apr/23 13:54
• Updated: 28/Jan/24 01:03
• Resolved: 10/May/23 09:31

Description

Caused by: org.apache.hadoop.ha.ServiceFailedException: RefreshAll operation failed
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshAll(AdminService.java:788)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.transitionToActive(AdminService.java:315)
    ... 29 more
Caused by: java.nio.file.NoSuchFileException: /tmp/non-existent-path-788aa744-1395-40ca-bdb5-f93bffc92cfb
    at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
    at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
    at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
    at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
    at java.nio.file.Files.newByteChannel(Files.java:361)
    at java.nio.file.Files.newByteChannel(Files.java:407)
    at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384)
    at java.nio.file.Files.newInputStream(Files.java:152)
    at org.apache.hadoop.util.HostsFileReader.readFileToMap(HostsFileReader.java:126)
    at org.apache.hadoop.util.HostsFileReader.refreshInternal(HostsFileReader.java:214)
    at org.apache.hadoop.util.HostsFileReader.refresh(HostsFileReader.java:192)
    at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.refreshHostsReader(NodesListManager.java:258)
    at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.refreshNodes(NodesListManager.java:232)
    at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.refreshNodes(NodesListManager.java:224)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshNodes(AdminService.java:490)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshAll(AdminService.java:778) 

Issue Links

• links to: GitHub Pull Request #5565