[AMBARI-5094] yarn.exclude FileNotFoundException during RM startup

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Assignee: Andrew Onischuk
• Reporter: Andrew Onischuk
• Created: 14/Mar/14 18:52
• Updated: 18/Mar/14 16:53
• Resolved: 18/Mar/14 16:53

Description

On an Ambari deployed cluster, the following configs are set in yarn-site.xml:
<property>
<name>yarn.resourcemanager.nodes.exclude-path</name>
<value>/etc/hadoop/conf/yarn.exclude</value>
</property>

and /etc/hadoop/conf/yarn.exclude does not exist.

This causes an error to be thrown in RM logs:

2014-02-26 15:34:19,721 WARN org.apache.hadoop.yarn.server.resourcemanager.NodesListManager: Failed to init hostsReader, disabling
java.io.FileNotFoundException: /etc/hadoop/conf/yarn.exclude (No such file or directory)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at java.io.FileInputStream.<init>(FileInputStream.java:97)
        at org.apache.hadoop.yarn.LocalConfigurationProvider.getConfigurationInputStream(LocalConfigurationProvider.java:45)
        at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.createHostsFileReader(NodesListManager.java:219)
        at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.serviceInit(NodesListManager.java:76)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:451)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:804)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:217)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1016)
2014-02-26 15:34:19,723 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list

The error is harmless and RM starts up fine but with this exception in the logs. Either an empty file should be created or the property has to be removed from yarn-site.xml

Issue Links

• links to: ReviewBoard