[YARN-6117] SharedCacheManager does not start up

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3, 3.0.0-alpha2
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Hadoop Flags: Reviewed
• Assignee: Chris Trezzo
• Reporter: Chris Trezzo
• Created: 23/Jan/17 22:38
• Updated: 30/Jan/17 21:23
• Resolved: 24/Jan/17 05:08

Description

The webapp directory for the SharedCacheManager is missing and the SCM fails to start up with the following:

2017-01-22 00:14:25,162 INFO org.apache.hadoop.service.AbstractService: Service SharedCacheManager failed in state STARTED; cause: org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
        at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:330)
        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:377)
        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:373)
        at org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer.serviceStart(SCMWebServer.java:65)
        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.main(SharedCacheManager.java:157)
Caused by: java.io.FileNotFoundException: webapps/sharedcache not found in CLASSPATH
        at org.apache.hadoop.http.HttpServer2.getWebAppsPath(HttpServer2.java:972)
        at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:478)
        at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:117)
        at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:392)
        at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:291)
        ... 7 more

Issue Links

• is related to: YARN-1492 truly shared cache for jars (jobjar/libjar)