Details

      Description

      Seem like yarn proxyserver is not operational when running out of the 0.23.1 RC2 tarball.

      1. Setting yarn.web-proxy.address to match yarn.resourcemanager.address doesn't disable the proxyserver (althought not setting yarn.web-proxy.address at all correctly disable it and produces a message: org.apache.hadoop.yarn.YarnException: yarn.web-proxy.address is not set so the proxy will not run). This contradicts the documentation provided for yarn.web-proxy.address in yarn-default.xml
      1. Setting yarn.web-proxy.address and running the service results in the following:
      $ ./sbin/yarn-daemon.sh start proxyserver 
      starting proxyserver, logging to /tmp/hadoop-0.23.1/logs/yarn-rvs-proxyserver-ahmed-laptop.out
      /usr/java/64/jdk1.6.0_22/bin/java -Dproc_proxyserver -Xmx1000m -Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=/tmp/hadoop-0.23.1/logs -Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir= -Dyarn.id.str=rvs -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native -Dyarn.policy.file=hadoop-policy.xml -Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=/tmp/hadoop-0.23.1/logs -Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir=/tmp/hadoop-0.23.1 -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native -classpath /tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/share/hadoop/common/lib/*:/tmp/hadoop-0.23.1/share/hadoop/common/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs:/tmp/hadoop-0.23.1/share/hadoop/hdfs/lib/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/* org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer
      

      with the following message found in the logs:

      2012-02-24 09:26:31,099 FATAL org.apache.hadoop.yarn.server.webproxy.WebAppProxy: Could not start proxy web server
      java.io.FileNotFoundException: webapps/proxy not found in CLASSPATH
              at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:532)
              at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:224)
              at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:164)
              at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.start(WebAppProxy.java:85)
              at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
              at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:76)
      

        Issue Links

          Activity

          Roman Shaposhnik created issue -
          Patrick Taylor Ramsey made changes -
          Field Original Value New Value
          Link This issue is blocked by BIGTOP-464 [ BIGTOP-464 ]
          Patrick Taylor Ramsey made changes -
          Link This issue is blocked by BIGTOP-464 [ BIGTOP-464 ]
          Patrick Taylor Ramsey made changes -
          Link This issue is related to BIGTOP-464 [ BIGTOP-464 ]
          Devaraj K made changes -
          Assignee Devaraj K [ devaraj.k ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3916.patch [ 12520600 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 2.0.0 [ 12320354 ]
          Affects Version/s 3.0.0 [ 12320355 ]
          Target Version/s 2.0.0, 3.0.0 [ 12320354, 12320355 ]
          Labels mrv2
          Devaraj K made changes -
          Target Version/s 3.0.0, 2.0.0 [ 12320355, 12320354 ] 2.0.0, 3.0.0 [ 12320354, 12320355 ]
          Priority Major [ 3 ] Critical [ 2 ]
          Alejandro Abdelnur made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Target Version/s 3.0.0, 2.0.0 [ 12320355, 12320354 ] 2.0.0, 3.0.0 [ 12320354, 12320355 ]
          Fix Version/s 2.0.0 [ 12320354 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Devaraj K
              Reporter:
              Roman Shaposhnik
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development