Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4048

NullPointerException exception while accessing the Application Master UI

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha, 3.0.0
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None

      Description

      2012-03-21 10:21:31,838 ERROR [2145015588@qtp-957250718-801] org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /mapreduce/attempts/job_1332261815858_2_8/m/KILLED
      java.lang.reflect.InvocationTargetException
              at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
              at java.lang.reflect.Method.invoke(Method.java:597)
              at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:150)
              at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
              at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
              at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
              at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
              at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
              at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:900)
              at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834)
              .......
              at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
              at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
              at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
      Caused by: java.lang.NullPointerException
              at com.google.common.base.Joiner.toString(Joiner.java:317)
              at com.google.common.base.Joiner.appendTo(Joiner.java:97)
              at com.google.common.base.Joiner.appendTo(Joiner.java:127)
              at com.google.common.base.Joiner.join(Joiner.java:158)
              at com.google.common.base.Joiner.join(Joiner.java:166)
              at org.apache.hadoop.yarn.util.StringHelper.join(StringHelper.java:102)
              at org.apache.hadoop.mapreduce.v2.app.webapp.AppController.badRequest(AppController.java:319)
              at org.apache.hadoop.mapreduce.v2.app.webapp.AppController.attempts(AppController.java:286)
              ... 36 more
      
      1. MAPREDUCE-4048.patch
        2 kB
        Devaraj K
      2. MAPREDUCE-4048-1.patch
        5 kB
        Devaraj K

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Patch Available Patch Available Open Open
        8d 5h 40m 1 Robert Joseph Evans 19/Apr/12 20:56
        Open Open Patch Available Patch Available
        35d 20h 55m 2 Devaraj K 04/May/12 13:37
        Patch Available Patch Available Resolved Resolved
        2h 28m 1 Robert Joseph Evans 04/May/12 16:05
        Resolved Resolved Closed Closed
        19d 5h 22m 1 Arun C Murthy 23/May/12 21:28
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322471 ]
        Fix Version/s 2.0.0-alpha [ 12320354 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1070 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1070/)
        MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1070 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1070/ ) MAPREDUCE-4048 . NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1035 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1035/)
        MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1035 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1035/ ) MAPREDUCE-4048 . NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #248 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/248/)
        svn merge -c 1334013 FIXES: MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334015)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334015
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #248 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/248/ ) svn merge -c 1334013 FIXES: MAPREDUCE-4048 . NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334015) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334015 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #2205 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2205/)
        MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013)

        Result = ABORTED
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2205 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2205/ ) MAPREDUCE-4048 . NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013) Result = ABORTED bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #2187 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2187/)
        MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2187 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2187/ ) MAPREDUCE-4048 . NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #2261 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2261/)
        MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2261 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2261/ ) MAPREDUCE-4048 . NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) (Revision 1334013) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1334013 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAppController.java
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.23.3 [ 12320060 ]
        Fix Version/s 2.0.0 [ 12320354 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Resolution Fixed [ 1 ]
        Hide
        Robert Joseph Evans added a comment -

        Thanks for the updates to the patch Devaraj. +1

        I put this into trunk, branch-2, and branch-0.23

        Show
        Robert Joseph Evans added a comment - Thanks for the updates to the patch Devaraj. +1 I put this into trunk, branch-2, and branch-0.23
        Hide
        Devaraj K added a comment -
        -1 javadoc. The javadoc tool appears to have generated 2 warning messages.
        

        These javadoc warnings are not related to the patch.

        Show
        Devaraj K added a comment - -1 javadoc. The javadoc tool appears to have generated 2 warning messages. These javadoc warnings are not related to the patch.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12525596/MAPREDUCE-4048-1.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        -1 javadoc. The javadoc tool appears to have generated 2 warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2357//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2357//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12525596/MAPREDUCE-4048-1.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified test files. -1 javadoc. The javadoc tool appears to have generated 2 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2357//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2357//console This message is automatically generated.
        Devaraj K made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Devaraj K added a comment -

        Thanks a lot for the review.

        The patch looks good for the most part, but I would like to see the test also cover badRequest(null), which is the case that is causing the error.

        The test was handling both the scenario's with null and without null message. Anyway I have made it separate cases now in the updated patch.

        Oh also because the message itself is null, there is no good way to debug the issue. Could you look at where badRequest is called and see if we need to log the error before displaying the error page.

        I have added the logs where there is a chance to call badRequest() with null message.

        Show
        Devaraj K added a comment - Thanks a lot for the review. The patch looks good for the most part, but I would like to see the test also cover badRequest(null), which is the case that is causing the error. The test was handling both the scenario's with null and without null message. Anyway I have made it separate cases now in the updated patch. Oh also because the message itself is null, there is no good way to debug the issue. Could you look at where badRequest is called and see if we need to log the error before displaying the error page. I have added the logs where there is a chance to call badRequest() with null message.
        Devaraj K made changes -
        Attachment MAPREDUCE-4048-1.patch [ 12525596 ]
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Hide
        Robert Joseph Evans added a comment -

        Oh also because the message itself is null, there is no good way to debug the issue. Could you look at where badRequest is called and see if we need to log the error before displaying the error page.

        Show
        Robert Joseph Evans added a comment - Oh also because the message itself is null, there is no good way to debug the issue. Could you look at where badRequest is called and see if we need to log the error before displaying the error page.
        Hide
        Robert Joseph Evans added a comment -

        The patch looks good for the most part, but I would like to see the test also cover badRequest(null), which is the case that is causing the error.

        Show
        Robert Joseph Evans added a comment - The patch looks good for the most part, but I would like to see the test also cover badRequest(null), which is the case that is causing the error.
        Devaraj K made changes -
        Component/s mrv2 [ 12314301 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12522251/MAPREDUCE-4048.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
        org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
        org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
        org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2199//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2199//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12522251/MAPREDUCE-4048.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2199//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2199//console This message is automatically generated.
        Devaraj K made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 2.0.0 [ 12320354 ]
        Affects Version/s 3.0.0 [ 12320355 ]
        Affects Version/s 0.23.1 [ 12318883 ]
        Hide
        Devaraj K added a comment -

        I have attached patch to fix this.

        Show
        Devaraj K added a comment - I have attached patch to fix this.
        Devaraj K made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-4048.patch [ 12522251 ]
        Devaraj K created issue -

          People

          • Assignee:
            Devaraj K
            Reporter:
            Devaraj K
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development