Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3600

AM container link is broken (on a killed application, at least)

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Running some fairly recent (couple weeks ago) version of 2.8.0-SNAPSHOT.
      I have an application that ran fine for a while and then I yarn kill-ed it. Now when I go to the only app attempt URL (like so: http://(snip RM host name):8088/cluster/appattempt/appattempt_1429683757595_0795_000001)

      I see:
      AM Container: container_1429683757595_0795_01_000001
      Node: N/A

      and the container link goes to

      http://(snip RM host name):8088/cluster/N/A
      

      which obviously doesn't work

        Activity

        Hide
        sershe Sergey Shelukhin added a comment -

        Vinod Kumar Vavilapalli ran into this recently... can you guys take a look

        Show
        sershe Sergey Shelukhin added a comment - Vinod Kumar Vavilapalli ran into this recently... can you guys take a look
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        It was failing in both cases when app is completed or killed and also null was displayed when AM container is not launched. Uploading a patch with the correction. Devaraj K can you please take a look

        Show
        Naganarasimha Naganarasimha G R added a comment - It was failing in both cases when app is completed or killed and also null was displayed when AM container is not launched. Uploading a patch with the correction. Devaraj K can you please take a look
        Hide
        tgraves Thomas Graves added a comment -

        reviewing and kicking jenkins.

        Show
        tgraves Thomas Graves added a comment - reviewing and kicking jenkins.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 14m 43s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 7m 32s There were no new javac warning messages.
        +1 javadoc 9m 38s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        +1 checkstyle 0m 47s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 34s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 1m 17s The patch does not introduce any new Findbugs (version 2.0.3) warnings.
        +1 yarn tests 53m 14s Tests passed in hadoop-yarn-server-resourcemanager.
            89m 42s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12731426/YARN-3600.20150508-1.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 9757864
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/7804/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/7804/testReport/
        Java 1.7.0_55
        uname Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/7804/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 43s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 32s There were no new javac warning messages. +1 javadoc 9m 38s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 47s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 34s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 17s The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 yarn tests 53m 14s Tests passed in hadoop-yarn-server-resourcemanager.     89m 42s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12731426/YARN-3600.20150508-1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 9757864 hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/7804/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/7804/testReport/ Java 1.7.0_55 uname Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/7804/console This message was automatically generated.
        Hide
        tgraves Thomas Graves added a comment -

        So the change does fix the broken link issue, but it seems to me other things are broken with this page. Obviously if it ran for a while it got an AM and there fore should have a valid container. But I guess that link only works if its actually running?

        The container table below that also confused me a bit. I thought at first it was list of AM containers, but after playing with it its really list of running containers. I think we should add heading for that. I filed separate jira for those things.

        Anyway, +1. Thanks!

        Show
        tgraves Thomas Graves added a comment - So the change does fix the broken link issue, but it seems to me other things are broken with this page. Obviously if it ran for a while it got an AM and there fore should have a valid container. But I guess that link only works if its actually running? The container table below that also confused me a bit. I thought at first it was list of AM containers, but after playing with it its really list of running containers. I think we should add heading for that. I filed separate jira for those things. Anyway, +1. Thanks!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #7776 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7776/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7776 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7776/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks for reviewing and committing Thomas Graves and raising YARN-3603, which is a valid issue to solve !

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks for reviewing and committing Thomas Graves and raising YARN-3603 , which is a valid issue to solve !
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 14m 40s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 7m 35s There were no new javac warning messages.
        +1 javadoc 9m 37s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        +1 checkstyle 0m 47s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 34s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 1m 16s The patch does not introduce any new Findbugs (version 2.0.3) warnings.
        +1 yarn tests 52m 13s Tests passed in hadoop-yarn-server-resourcemanager.
            88m 46s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12731426/YARN-3600.20150508-1.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / bcf2890
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/7809/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/7809/testReport/
        Java 1.7.0_55
        uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/7809/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 40s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 35s There were no new javac warning messages. +1 javadoc 9m 37s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 47s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 34s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 16s The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 yarn tests 52m 13s Tests passed in hadoop-yarn-server-resourcemanager.     88m 46s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12731426/YARN-3600.20150508-1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / bcf2890 hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/7809/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/7809/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/7809/console This message was automatically generated.
        Hide
        sseth Siddharth Seth added a comment -

        I think the intent here was to be able to access logs for a completed job - from the RM UI. That used to work earlier and is extremely useful.

        Show
        sseth Siddharth Seth added a comment - I think the intent here was to be able to access logs for a completed job - from the RM UI. That used to work earlier and is extremely useful.
        Hide
        tgraves Thomas Graves added a comment -

        Hey Siddharth Seth,

        Can you check to make sure YARN-3603 covers what you also think it should do? I added the bit about logs in there but I may have forgot about something else.

        Show
        tgraves Thomas Graves added a comment - Hey Siddharth Seth , Can you check to make sure YARN-3603 covers what you also think it should do? I added the bit about logs in there but I may have forgot about something else.
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        hi Siddharth Seth,
        Was not aware of the earlier approach and also as container information is not available i took this approach, but IMO approach to select log in the earlier approach you mentioned is not so user friendly better we display the log url in the app attempt's page itself IIUC which is what is suggested by Thomas Graves in YARN-3603. Is that fine ?

        Show
        Naganarasimha Naganarasimha G R added a comment - hi Siddharth Seth , Was not aware of the earlier approach and also as container information is not available i took this approach, but IMO approach to select log in the earlier approach you mentioned is not so user friendly better we display the log url in the app attempt's page itself IIUC which is what is suggested by Thomas Graves in YARN-3603 . Is that fine ?
        Hide
        sseth Siddharth Seth added a comment -

        Sounds good. Sorry I missed YARN-3603.

        Show
        sseth Siddharth Seth added a comment - Sounds good. Sorry I missed YARN-3603 .
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #191 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/191/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #191 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/191/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #922 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/922/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #922 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/922/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2120 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2120/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        • hadoop-yarn-project/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2120 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2120/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java hadoop-yarn-project/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #180 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/180/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        • hadoop-yarn-project/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #180 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/180/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java hadoop-yarn-project/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/190/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        • hadoop-yarn-project/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/190/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java hadoop-yarn-project/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2138 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2138/)
        YARN-3600. AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)

        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2138 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2138/ ) YARN-3600 . AM container link is broken (Naganarasimha G R via tgraves (tgraves: rev 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppAttemptBlock.java

          People

          • Assignee:
            Naganarasimha Naganarasimha G R
            Reporter:
            sershe Sergey Shelukhin
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development