Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-321 [Umbrella] Generic application history service
  3. YARN-2900

Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

    Details

    • Target Version/s:

      Description

      Caused by: java.lang.NullPointerException
      at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerImpl.convertToApplicationReport(ApplicationHistoryManagerImpl.java:128)
      at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerImpl.getApplication(ApplicationHistoryManagerImpl.java:118)
      at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:222)
      at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:219)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1679)
      at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:218)
      ... 59 more

      1. YARN-2900.patch
        1 kB
        Mit Desai
      2. YARN-2900.patch
        6 kB
        Mit Desai
      3. YARN-2900.patch
        11 kB
        Mit Desai
      4. YARN-2900.patch
        23 kB
        Mit Desai
      5. YARN-2900.patch
        24 kB
        Mit Desai
      6. YARN-2900.patch
        21 kB
        Mit Desai
      7. YARN-2900.patch
        21 kB
        Mit Desai
      8. YARN-2900.patch
        20 kB
        Mit Desai
      9. YARN-2900-b2.patch
        21 kB
        Mit Desai
      10. YARN-2900-b2-2.patch
        21 kB
        Mit Desai
      11. YARN-2900.20150529.patch
        9 kB
        Zhijie Shen
      12. YARN-2900.20150530.patch
        11 kB
        Zhijie Shen
      13. YARN-2900-branch-2.7.20150530.patch
        11 kB
        Zhijie Shen
      14. YARN-2900.20150530.patch
        11 kB
        Xuan Gong

        Issue Links

          Activity

          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Pulled this into 2.6.1 after fixing minor import issues.

          Ran compilation and TestApplicationHistoryClientService before the push.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Pulled this into 2.6.1 after fixing minor import issues. Ran compilation and TestApplicationHistoryClientService before the push.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2161 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2161/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2161 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2161/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #213 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/213/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #213 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/213/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #204 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/204/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #204 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/204/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk #2143 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2143/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #2143 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2143/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #945 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/945/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #945 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/945/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #215 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/215/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #215 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/215/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/CHANGES.txt
          Hide
          xgong Xuan Gong added a comment -

          Committed into trunk/branch-2/branch-2.7. Thanks, Zhijie and Mit Desai

          Show
          xgong Xuan Gong added a comment - Committed into trunk/branch-2/branch-2.7. Thanks, Zhijie and Mit Desai
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7937 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7937/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7937 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7937/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 9686261ecb872ad159fac3ca44f1792143c6d7db) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2160 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2160/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
            Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2160 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2160/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #212 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/212/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
            Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #212 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/212/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk #2142 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2142/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
            Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #2142 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2142/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #203 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/203/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/CHANGES.txt
            Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #203 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/203/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/CHANGES.txt Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #944 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/944/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
            Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #944 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/944/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #214 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/214/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
            Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #214 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/214/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 15m 50s Findbugs (version 3.0.0) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 36s There were no new javac warning messages.
          +1 javadoc 9m 36s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 48s There were no new checkstyle issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          -1 findbugs 1m 58s The patch appears to introduce 3 new Findbugs (version 3.0.0) warnings.
          -1 yarn tests 3m 4s Tests failed in hadoop-yarn-server-applicationhistoryservice.
          +1 yarn tests 0m 24s Tests passed in hadoop-yarn-server-common.
              41m 49s  



          Reason Tests
          FindBugs module:hadoop-yarn-server-common
          Failed unit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12736411/YARN-2900.20150530.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / da05361
          Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/8144/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
          hadoop-yarn-server-applicationhistoryservice test log https://builds.apache.org/job/PreCommit-YARN-Build/8144/artifact/patchprocess/testrun_hadoop-yarn-server-applicationhistoryservice.txt
          hadoop-yarn-server-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8144/artifact/patchprocess/testrun_hadoop-yarn-server-common.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8144/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8144/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 15m 50s Findbugs (version 3.0.0) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 36s There were no new javac warning messages. +1 javadoc 9m 36s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 48s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. -1 findbugs 1m 58s The patch appears to introduce 3 new Findbugs (version 3.0.0) warnings. -1 yarn tests 3m 4s Tests failed in hadoop-yarn-server-applicationhistoryservice. +1 yarn tests 0m 24s Tests passed in hadoop-yarn-server-common.     41m 49s   Reason Tests FindBugs module:hadoop-yarn-server-common Failed unit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12736411/YARN-2900.20150530.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / da05361 Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/8144/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html hadoop-yarn-server-applicationhistoryservice test log https://builds.apache.org/job/PreCommit-YARN-Build/8144/artifact/patchprocess/testrun_hadoop-yarn-server-applicationhistoryservice.txt hadoop-yarn-server-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8144/artifact/patchprocess/testrun_hadoop-yarn-server-common.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8144/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8144/console This message was automatically generated.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7935 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7935/)
          Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7935 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7935/ ) Revert " YARN-2900 . Application (Attempt and Container) Not Found in AHS results" (xgong: rev da05361c3bc63238bbcb3675b690def8fcccd8e2) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java hadoop-yarn-project/CHANGES.txt
          Hide
          xgong Xuan Gong added a comment -

          Thanks. I have already reverted the patch committed into trunk/branch-2.
          Resubmit the same patch to kick the Jenkins. Will commit the patch if the Jenkins say ok

          Show
          xgong Xuan Gong added a comment - Thanks. I have already reverted the patch committed into trunk/branch-2. Resubmit the same patch to kick the Jenkins. Will commit the patch if the Jenkins say ok
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 patch 0m 0s The patch command could not apply the patch during dryrun.



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12736409/YARN-2900-branch-2.7.20150530.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / 06f8e9c
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8143/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 patch 0m 0s The patch command could not apply the patch during dryrun. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12736409/YARN-2900-branch-2.7.20150530.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / 06f8e9c Console output https://builds.apache.org/job/PreCommit-YARN-Build/8143/console This message was automatically generated.
          Hide
          zjshen Zhijie Shen added a comment -

          Xuan Gong, I just realize the last patch I've created has missed one test class change from Mit.

          I recreated the patch for trunk/branch-2 and that for branch-2.7. Would you please revert the old commit and check in the new one.

          BTW, TestAHSWebservices is going to fail, but it's due to YARN-3751.

          Show
          zjshen Zhijie Shen added a comment - Xuan Gong , I just realize the last patch I've created has missed one test class change from Mit. I recreated the patch for trunk/branch-2 and that for branch-2.7. Would you please revert the old commit and check in the new one. BTW, TestAHSWebservices is going to fail, but it's due to YARN-3751 .
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7934 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7934/)
          YARN-2900. Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7934 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7934/ ) YARN-2900 . Application (Attempt and Container) Not Found in AHS results (xgong: rev 06f8e9cabaf3c05cd7d16215cff47265ea773f39) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline/webapp/TimelineWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java
          Hide
          xgong Xuan Gong added a comment -

          Zhijie Shen I have committed the patch into trunk/branch-2. But looks like it does not apply for branch-2.7. Could you work a patch for branch-2.7 ?

          Show
          xgong Xuan Gong added a comment - Zhijie Shen I have committed the patch into trunk/branch-2. But looks like it does not apply for branch-2.7. Could you work a patch for branch-2.7 ?
          Hide
          xgong Xuan Gong added a comment -

          +1. Check this in

          Show
          xgong Xuan Gong added a comment - +1. Check this in
          Hide
          mitdesai Mit Desai added a comment -

          looks good to me. Thanks Zhijie Shen for your looking into it.

          Show
          mitdesai Mit Desai added a comment - looks good to me. Thanks Zhijie Shen for your looking into it.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 39s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 7m 41s There were no new javac warning messages.
          +1 javadoc 9m 35s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 1m 4s The applied patch generated 4 new checkstyle issues (total was 52, now 56).
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 38s mvn install still works.
          +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
          -1 findbugs 2m 3s The patch appears to introduce 3 new Findbugs (version 3.0.0) warnings.
          +1 yarn tests 3m 4s Tests passed in hadoop-yarn-server-applicationhistoryservice.
          +1 yarn tests 0m 24s Tests passed in hadoop-yarn-server-common.
              43m 12s  



          Reason Tests
          FindBugs module:hadoop-yarn-server-common



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12736223/YARN-2900.20150529.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 6aec13c
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/diffcheckstylehadoop-yarn-server-common.txt
          Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
          hadoop-yarn-server-applicationhistoryservice test log https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/testrun_hadoop-yarn-server-applicationhistoryservice.txt
          hadoop-yarn-server-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/testrun_hadoop-yarn-server-common.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8133/testReport/
          Java 1.7.0_55
          uname Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8133/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 39s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 41s There were no new javac warning messages. +1 javadoc 9m 35s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 4s The applied patch generated 4 new checkstyle issues (total was 52, now 56). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 38s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. -1 findbugs 2m 3s The patch appears to introduce 3 new Findbugs (version 3.0.0) warnings. +1 yarn tests 3m 4s Tests passed in hadoop-yarn-server-applicationhistoryservice. +1 yarn tests 0m 24s Tests passed in hadoop-yarn-server-common.     43m 12s   Reason Tests FindBugs module:hadoop-yarn-server-common Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12736223/YARN-2900.20150529.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 6aec13c checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/diffcheckstylehadoop-yarn-server-common.txt Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html hadoop-yarn-server-applicationhistoryservice test log https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/testrun_hadoop-yarn-server-applicationhistoryservice.txt hadoop-yarn-server-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8133/artifact/patchprocess/testrun_hadoop-yarn-server-common.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8133/testReport/ Java 1.7.0_55 uname Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8133/console This message was automatically generated.
          Hide
          xgong Xuan Gong added a comment -

          Thanks for the patch, Looks fine to me.
          Mit Desai, Jonathan Eagles Do you have any other comments ?

          Show
          xgong Xuan Gong added a comment - Thanks for the patch, Looks fine to me. Mit Desai , Jonathan Eagles Do you have any other comments ?
          Hide
          zjshen Zhijie Shen added a comment -

          Mit Desai, thanks for the last patch, but I realize that there's one behavior change w.r.t letting ApplicationHistoryManagerOnTimelineStore return null instead of throwing exception. Before the patch, when we get an attempt or a container, we will signal different exception to let user know if the app is completely missing or we just don't fine the particular attempt or container. So I create another patch that retains your test cases, but fix 500->404 problem by mapping the not found exception to 404 in web services class, which should be more lightweight. Xuan Gong, can you take a look at this patch too?

          Another issue is java.lang.IllegalStateException: STREAM that I observed during my local test. It seems not to be caused by this Jira, but to be an existing problem when YARN web app returns 404 and accepts XML content. I could see both RM and ATS REST API are encountering the same issue. I filed a separate Jira for it: YARN-3746

          Show
          zjshen Zhijie Shen added a comment - Mit Desai , thanks for the last patch, but I realize that there's one behavior change w.r.t letting ApplicationHistoryManagerOnTimelineStore return null instead of throwing exception. Before the patch, when we get an attempt or a container, we will signal different exception to let user know if the app is completely missing or we just don't fine the particular attempt or container. So I create another patch that retains your test cases, but fix 500->404 problem by mapping the not found exception to 404 in web services class, which should be more lightweight. Xuan Gong , can you take a look at this patch too? Another issue is java.lang.IllegalStateException: STREAM that I observed during my local test. It seems not to be caused by this Jira, but to be an existing problem when YARN web app returns 404 and accepts XML content. I could see both RM and ATS REST API are encountering the same issue. I filed a separate Jira for it: YARN-3746
          Hide
          mitdesai Mit Desai added a comment -

          Thanks! I am working on it currently and should have some update in couple hours

          Show
          mitdesai Mit Desai added a comment - Thanks! I am working on it currently and should have some update in couple hours
          Hide
          zjshen Zhijie Shen added a comment -

          Concurrent comment. Assign the jira back to you.

          Show
          zjshen Zhijie Shen added a comment - Concurrent comment. Assign the jira back to you.
          Hide
          mitdesai Mit Desai added a comment -

          The latest patch does not apply anymore. Attaching it again so it applies cleanly.
          Zhijie Shen, sorry I could not get to this soon.

          Show
          mitdesai Mit Desai added a comment - The latest patch does not apply anymore. Attaching it again so it applies cleanly. Zhijie Shen , sorry I could not get to this soon.
          Hide
          zjshen Zhijie Shen added a comment -

          Take it over to move it forward.

          Show
          zjshen Zhijie Shen added a comment - Take it over to move it forward.
          Hide
          zjshen Zhijie Shen added a comment -

          Mit Desai, are you still working on this jira? Any luck to find the cause of the problem mentioned before?

          Show
          zjshen Zhijie Shen added a comment - Mit Desai , are you still working on this jira? Any luck to find the cause of the problem mentioned before?
          Hide
          mitdesai Mit Desai added a comment -

          I am yet to verify that. Will try to get to this soon

          Show
          mitdesai Mit Desai added a comment - I am yet to verify that. Will try to get to this soon
          Hide
          mitdesai Mit Desai added a comment -

          I was stuck in something else. I'll update on that by tomorrow

          Show
          mitdesai Mit Desai added a comment - I was stuck in something else. I'll update on that by tomorrow
          Hide
          zjshen Zhijie Shen added a comment -

          Mit Desai, have you got the change to fix java.lang.IllegalStateException: STREAM?

          Show
          zjshen Zhijie Shen added a comment - Mit Desai , have you got the change to fix java.lang.IllegalStateException: STREAM ?
          Hide
          zjshen Zhijie Shen added a comment -

          Mit Desai, the problem mentioned before is fixed?

          Show
          zjshen Zhijie Shen added a comment - Mit Desai , the problem mentioned before is fixed?
          Hide
          mitdesai Mit Desai added a comment -

          ApplicationHistoryClientService got changed recently. So this patch needs to be reworked.

          Show
          mitdesai Mit Desai added a comment - ApplicationHistoryClientService got changed recently. So this patch needs to be reworked.
          Hide
          mitdesai Mit Desai added a comment -

          I'll update it shortly

          Show
          mitdesai Mit Desai added a comment - I'll update it shortly
          Hide
          leftnoteasy Wangda Tan added a comment -

          Mit Desai, is the problem still exist? Could you update the patch?

          Show
          leftnoteasy Wangda Tan added a comment - Mit Desai , is the problem still exist? Could you update the patch?
          Hide
          mitdesai Mit Desai added a comment -

          I think you were still using the old FS history store.

          Yes, I did not make that config change. Verified after changing the history store that I can reproduce the problem too.

          Show
          mitdesai Mit Desai added a comment - I think you were still using the old FS history store. Yes, I did not make that config change. Verified after changing the history store that I can reproduce the problem too.
          Hide
          zjshen Zhijie Shen added a comment -

          I think you were still using the old FS history store.

          Caused by: java.io.IOException: History file for application application_1417818619773_0002 is not found
          	at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getHistoryFileReader(FileSystemApplicationHistoryStore.java:663)
          	at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getApplication(FileSystemApplicationHistoryStore.java:156)
          

          I debugged for a while. Only throwing NotFoundException will result in the exception stack I've posted. While even throwing FobbidenException is still okay. I still didn't figure out why it happened only to NotFoundException.

          In addition, I found one more bug. getApplicationAttempts() and getContainers() should return the empty map instead of null, which is the expected behavior before, and callers assume not null too. Returning null will resulting NPE.

          Show
          zjshen Zhijie Shen added a comment - I think you were still using the old FS history store. Caused by: java.io.IOException: History file for application application_1417818619773_0002 is not found at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getHistoryFileReader(FileSystemApplicationHistoryStore.java:663) at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getApplication(FileSystemApplicationHistoryStore.java:156) I debugged for a while. Only throwing NotFoundException will result in the exception stack I've posted. While even throwing FobbidenException is still okay. I still didn't figure out why it happened only to NotFoundException. In addition, I found one more bug. getApplicationAttempts() and getContainers() should return the empty map instead of null, which is the expected behavior before, and callers assume not null too. Returning null will resulting NPE.
          Hide
          mitdesai Mit Desai added a comment -

          Zhijie Shen, I did get an exception by following the steps you mentioned. But I did not reproduce the scenario that you did.

          This is the exception that I get in the timeline server logs.

          2014-12-09 16:18:51,632 WARN  [1920631011@qtp-530634372-8] webapp.GenericExceptionHandler (GenericExceptionHandler.java:toResponse(98)) - INTERNAL_SERVER_ERROR
          javax.ws.rs.WebApplicationException: java.io.IOException: History file for application application_1417818619773_0002 is not found
          	at org.apache.hadoop.yarn.server.webapp.WebServices.rewrapAndThrowException(WebServices.java:458)
          	at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:227)
          	at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSWebServices.getApp(AHSWebServices.java:95)
          	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
          	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          	at java.lang.reflect.Method.invoke(Method.java:606)
          	at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
          	at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
          	at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
          	at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
          	at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
          	at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
          	at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
          	at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
          	at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
          	at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
          	at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
          	at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
          	at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:886)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:795)
          	at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
          	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
          	at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
          	at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:96)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:594)
          	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:277)
          	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:557)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1204)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
          	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
          	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
          	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
          	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
          	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
          	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
          	at org.mortbay.jetty.Server.handle(Server.java:326)
          	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
          	at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
          	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
          	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
          	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
          	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
          	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
          Caused by: java.io.IOException: History file for application application_1417818619773_0002 is not found
          	at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getHistoryFileReader(FileSystemApplicationHistoryStore.java:663)
          	at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getApplication(FileSystemApplicationHistoryStore.java:156)
          	at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerImpl.getApplication(ApplicationHistoryManagerImpl.java:118)
          	at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:222)
          	at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:219)
          	at java.security.AccessController.doPrivileged(Native Method)
          	at javax.security.auth.Subject.doAs(Subject.java:415)
          	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669)
          	at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:218)
          	... 54 more
          

          And the WebUI shows me this

          This XML file does not appear to have any style information associated with it. The document tree is shown below.
          <RemoteException>
          <exception>WebApplicationException</exception>
          <message>
          java.io.IOException: History file for application application_1417818619773_0002 is not found
          </message>
          <javaClassName>javax.ws.rs.WebApplicationException</javaClassName>
          </RemoteException>
          
          Show
          mitdesai Mit Desai added a comment - Zhijie Shen , I did get an exception by following the steps you mentioned. But I did not reproduce the scenario that you did. This is the exception that I get in the timeline server logs. 2014-12-09 16:18:51,632 WARN [1920631011@qtp-530634372-8] webapp.GenericExceptionHandler (GenericExceptionHandler.java:toResponse(98)) - INTERNAL_SERVER_ERROR javax.ws.rs.WebApplicationException: java.io.IOException: History file for application application_1417818619773_0002 is not found at org.apache.hadoop.yarn.server.webapp.WebServices.rewrapAndThrowException(WebServices.java:458) at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:227) at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSWebServices.getApp(AHSWebServices.java:95) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339) at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416) at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537) at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:886) at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834) at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:795) at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163) at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58) at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118) at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:96) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:594) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:277) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:557) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1204) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: java.io.IOException: History file for application application_1417818619773_0002 is not found at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getHistoryFileReader(FileSystemApplicationHistoryStore.java:663) at org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore.getApplication(FileSystemApplicationHistoryStore.java:156) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerImpl.getApplication(ApplicationHistoryManagerImpl.java:118) at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:222) at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:219) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:218) ... 54 more And the WebUI shows me this This XML file does not appear to have any style information associated with it. The document tree is shown below. <RemoteException> <exception>WebApplicationException</exception> <message> java.io.IOException: History file for application application_1417818619773_0002 is not found </message> <javaClassName>javax.ws.rs.WebApplicationException</javaClassName> </RemoteException>
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12685879/YARN-2900.patch
          against trunk revision ddffcd8.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6041//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6041//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12685879/YARN-2900.patch against trunk revision ddffcd8. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6041//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6041//console This message is automatically generated.
          Hide
          zjshen Zhijie Shen added a comment -

          I am not sure why the timelineserver throws some exception and we get a NotFound on the browser. Can you explain what was the test that you did here?

          What i did:

          1. Start the timeline server while system metrics publisher is enabled for RM.
          2. Submit a MR example job.
          3. Type http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0001?user.name=zshen in browser, and check the output, which is right.
          4. Type http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0002?user.name=zshen, and look for NOT_FOUND message. However no response at all. And I see the aforementioned exception in the timeline server log.

          I applied this patch on trunk, and I could reproduce this issue. Undoing this patch, http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0002?user.name=zshen will return Internal Server Error (500), which is the expected current behavior. Did you have a chance to reproduce it at ur side?

          Show
          zjshen Zhijie Shen added a comment - I am not sure why the timelineserver throws some exception and we get a NotFound on the browser. Can you explain what was the test that you did here? What i did: 1. Start the timeline server while system metrics publisher is enabled for RM. 2. Submit a MR example job. 3. Type http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0001?user.name=zshen in browser, and check the output, which is right. 4. Type http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0002?user.name=zshen , and look for NOT_FOUND message. However no response at all. And I see the aforementioned exception in the timeline server log. I applied this patch on trunk, and I could reproduce this issue. Undoing this patch, http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0002?user.name=zshen will return Internal Server Error (500), which is the expected current behavior. Did you have a chance to reproduce it at ur side?
          Hide
          mitdesai Mit Desai added a comment -

          Refining patch. Missed to remove unused import

          Show
          mitdesai Mit Desai added a comment - Refining patch. Missed to remove unused import
          Hide
          mitdesai Mit Desai added a comment -

          Attaching the patch that addresses the the NFE and indenting. I'll wait for your response on the IllegalStateException

          Show
          mitdesai Mit Desai added a comment - Attaching the patch that addresses the the NFE and indenting. I'll wait for your response on the IllegalStateException
          Hide
          mitdesai Mit Desai added a comment -

          Zhijie Shen, from the changes that the patch makes, only time that the NotFound is thrown is when there is no application|attempt|container that the client is asking for. I am not sure why the timelineserver throws some exception and we get a NotFound on the browser. Can you explain what was the test that you did here?

          Show
          mitdesai Mit Desai added a comment - Zhijie Shen , from the changes that the patch makes, only time that the NotFound is thrown is when there is no application|attempt|container that the client is asking for. I am not sure why the timelineserver throws some exception and we get a NotFound on the browser. Can you explain what was the test that you did here?
          Hide
          mitdesai Mit Desai added a comment -

          Thanks. I will check that out.

          Show
          mitdesai Mit Desai added a comment - Thanks. I will check that out.
          Hide
          zjshen Zhijie Shen added a comment -

          Some more comments on the patch:

          1. No need to handle NotFoundException in ApplicationHistoryClientService, right?

          2. Fix the following indent issues.

          +    if (report != null) {
          +    ApplicationReport appReport = report.appReport;
          +      if (appReport != null) {
          +        return appReport;
          +      }
          +    }
          
          +    } catch (ApplicationNotFoundException e) {
          +      //This exception is expected.
          +    Assert.assertTrue(e.getMessage().
          

          I tried the query http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0002?user.name=zshen. I obtained the following exception in the timeline server log, and saw not response from my browser.

          2014-12-05 14:33:43,791 ERROR org.mortbay.log: /ws/v1/applicationhistory/apps/application_1417818619773_0002
          java.lang.IllegalStateException: STREAM
          	at org.mortbay.jetty.Response.getWriter(Response.java:616)
          	at org.apache.hadoop.yarn.webapp.View.writer(View.java:141)
          	at org.apache.hadoop.yarn.webapp.view.TextView.writer(TextView.java:38)
          	at org.apache.hadoop.yarn.webapp.view.TextView.echo(TextView.java:46)
          	at org.apache.hadoop.yarn.webapp.view.TextView.puts(TextView.java:57)
          	at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:81)
          	at org.apache.hadoop.yarn.webapp.Dispatcher.render(Dispatcher.java:197)
          	at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:145)
          	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
          	at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
          	at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
          	at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
          	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:900)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834)
          	at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:795)
          	at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
          	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
          	at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
          	at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:96)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:592)
          	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:277)
          	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:555)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1204)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
          	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
          	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
          	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
          	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
          	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
          	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
          	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
          	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
          	at org.mortbay.jetty.Server.handle(Server.java:322)
          	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
          	at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
          	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
          	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
          	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
          	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
          	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
          

          I worked on trunk and before applying the patch, I can get 500 response as we expected before, and no exception in the timeline server. Would you please take a look?

          Show
          zjshen Zhijie Shen added a comment - Some more comments on the patch: 1. No need to handle NotFoundException in ApplicationHistoryClientService, right? 2. Fix the following indent issues. + if (report != null ) { + ApplicationReport appReport = report.appReport; + if (appReport != null ) { + return appReport; + } + } + } catch (ApplicationNotFoundException e) { + //This exception is expected. + Assert.assertTrue(e.getMessage(). I tried the query http://localhost:8188/ws/v1/applicationhistory/apps/application_1417818619773_0002?user.name=zshen . I obtained the following exception in the timeline server log, and saw not response from my browser. 2014-12-05 14:33:43,791 ERROR org.mortbay.log: /ws/v1/applicationhistory/apps/application_1417818619773_0002 java.lang.IllegalStateException: STREAM at org.mortbay.jetty.Response.getWriter(Response.java:616) at org.apache.hadoop.yarn.webapp.View.writer(View.java:141) at org.apache.hadoop.yarn.webapp.view.TextView.writer(TextView.java:38) at org.apache.hadoop.yarn.webapp.view.TextView.echo(TextView.java:46) at org.apache.hadoop.yarn.webapp.view.TextView.puts(TextView.java:57) at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:81) at org.apache.hadoop.yarn.webapp.Dispatcher.render(Dispatcher.java:197) at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:145) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263) at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178) at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91) at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62) at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:900) at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834) at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:795) at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163) at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58) at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118) at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:96) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:592) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:277) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:555) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1204) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:322) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) I worked on trunk and before applying the patch, I can get 500 response as we expected before, and no exception in the timeline server. Would you please take a look?
          Hide
          zjshen Zhijie Shen added a comment -

          Thanks, will come back to you soon.

          Show
          zjshen Zhijie Shen added a comment - Thanks, will come back to you soon.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12685325/YARN-2900.patch
          against trunk revision 0653918.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6003//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6003//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12685325/YARN-2900.patch against trunk revision 0653918. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6003//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6003//console This message is automatically generated.
          Hide
          mitdesai Mit Desai added a comment -

          Thanks for taking a look and providing useful comments Jonathan Eagles and Zhijie Shen.
          I have attached the new patch. Please take a look and let me know if this looks good.

          Show
          mitdesai Mit Desai added a comment - Thanks for taking a look and providing useful comments Jonathan Eagles and Zhijie Shen . I have attached the new patch. Please take a look and let me know if this looks good.
          Hide
          zjshen Zhijie Shen added a comment -

          Thanks for working on this bug, Mit Desai and Jonathan Eagles! Here's my feedback on this patch:

          1. Debug message is better to be wrapped in the if (LOG.isDebugEnabled()) block.

          2. NotFoundException is web only stuff. It shouldn't thrown from ApplicationHistoryManagerOnTimelineStore. Why not just returning null? If returning null, no change is required in WebServices, right?

          3. In ApplicationHistoryClientService, for those getXXXs() methods, we don't throw exception, but just return the empty list.

          4. In ApplicationHistoryClientService, take getApplicationReport for an example.

           GetApplicationReportResponse response =
                      GetApplicationReportResponse.newInstance(history
                        .getApplication(applicationId));
          

          could be changed to

          ApplicationReport appReport = history.getApplication(applicationId);
          if (appReport == null) {
            throw new ApplicationNotFoundException();
          }
          GetApplicationReportResponse response =
              GetApplicationReportResponse.newInstance(appReport);
          

          Other get-single-report methods can be changed accordingly.

          Show
          zjshen Zhijie Shen added a comment - Thanks for working on this bug, Mit Desai and Jonathan Eagles ! Here's my feedback on this patch: 1. Debug message is better to be wrapped in the if (LOG.isDebugEnabled()) block. 2. NotFoundException is web only stuff. It shouldn't thrown from ApplicationHistoryManagerOnTimelineStore. Why not just returning null? If returning null, no change is required in WebServices, right? 3. In ApplicationHistoryClientService, for those getXXXs() methods, we don't throw exception, but just return the empty list. 4. In ApplicationHistoryClientService, take getApplicationReport for an example. GetApplicationReportResponse response = GetApplicationReportResponse.newInstance(history .getApplication(applicationId)); could be changed to ApplicationReport appReport = history.getApplication(applicationId); if (appReport == null ) { throw new ApplicationNotFoundException(); } GetApplicationReportResponse response = GetApplicationReportResponse.newInstance(appReport); Other get-single-report methods can be changed accordingly.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12685209/YARN-2900.patch
          against trunk revision 7896815.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5999//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5999//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12685209/YARN-2900.patch against trunk revision 7896815. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5999//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5999//console This message is automatically generated.
          Hide
          jeagles Jonathan Eagles added a comment -

          +1. Zhijie Shen, any last comments before this goes in?

          Show
          jeagles Jonathan Eagles added a comment - +1. Zhijie Shen , any last comments before this goes in?
          Hide
          mitdesai Mit Desai added a comment -

          Refining the patch

          Show
          mitdesai Mit Desai added a comment - Refining the patch
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12684991/YARN-2900.patch
          against trunk revision 9d1a8f5.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5990//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5990//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12684991/YARN-2900.patch against trunk revision 9d1a8f5. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5990//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5990//console This message is automatically generated.
          Hide
          zjshen Zhijie Shen added a comment -

          Will take a look

          Show
          zjshen Zhijie Shen added a comment - Will take a look
          Hide
          mitdesai Mit Desai added a comment -

          Zhijie Shen, Jonathan Eagles: Attaching final patch with the fix and unit tests to verify it. Can you review?

          Show
          mitdesai Mit Desai added a comment - Zhijie Shen , Jonathan Eagles : Attaching final patch with the fix and unit tests to verify it. Can you review?
          Hide
          mitdesai Mit Desai added a comment -

          Zhijie Shen I am still working on the unit test. Meanwhile would you like to take a look at the changes that you suggested?

          Show
          mitdesai Mit Desai added a comment - Zhijie Shen I am still working on the unit test. Meanwhile would you like to take a look at the changes that you suggested?
          Hide
          zjshen Zhijie Shen added a comment -

          Thanks for the patch. Here're some comments:

          1. In ApplicationHistoryManagerOnTimelineStore, we need to take care of ApplicationAttemptNotFoundException and ContainerNotFoundException too.

          2. In ApplicationHistoryClientService, we should throw the aforementioned exception correspondingly.

          3. Please check what's the caller of getApplication. Make sure NPE won't happen when returning null.

          4. In TestApplicationHistoryClientService and TestAHSWebServices, can we add the test cases to cover the not found code path for get app|attempt|container?

          Show
          zjshen Zhijie Shen added a comment - Thanks for the patch. Here're some comments: 1. In ApplicationHistoryManagerOnTimelineStore, we need to take care of ApplicationAttemptNotFoundException and ContainerNotFoundException too. 2. In ApplicationHistoryClientService, we should throw the aforementioned exception correspondingly. 3. Please check what's the caller of getApplication. Make sure NPE won't happen when returning null. 4. In TestApplicationHistoryClientService and TestAHSWebServices, can we add the test cases to cover the not found code path for get app|attempt|container?
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12683618/YARN-2900.patch
          against trunk revision 61a2510.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5933//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5933//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12683618/YARN-2900.patch against trunk revision 61a2510. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5933//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5933//console This message is automatically generated.
          Hide
          mitdesai Mit Desai added a comment -

          Zhijie Shen Can you provide your feedback on the latest patch?
          I have tried to make sure I handled every place that needed modification and ran all tests in yarn.server.applicationhistoryservice package.

          Show
          mitdesai Mit Desai added a comment - Zhijie Shen Can you provide your feedback on the latest patch? I have tried to make sure I handled every place that needed modification and ran all tests in yarn.server.applicationhistoryservice package.
          Hide
          mitdesai Mit Desai added a comment -

          Thanks! I will post the updated patch following the discussion here. You can review it once its up.

          Show
          mitdesai Mit Desai added a comment - Thanks! I will post the updated patch following the discussion here. You can review it once its up.
          Hide
          zjshen Zhijie Shen added a comment -

          How about we just return a null if the entity == null in ApplicationHistoryManagerOnTimelineStore?

          This is fine, too. It should also benefit web UI.

          But please make sure that in ApplicationHistoryClientService, if xxxxReport == null, then throw XxxxNotFoundException. The initial consideration of not returning null, but throwing XXXNotFoundException is to be consistent with ClientRMServices. Thanks!

          Show
          zjshen Zhijie Shen added a comment - How about we just return a null if the entity == null in ApplicationHistoryManagerOnTimelineStore? This is fine, too. It should also benefit web UI. But please make sure that in ApplicationHistoryClientService, if xxxxReport == null, then throw XxxxNotFoundException. The initial consideration of not returning null, but throwing XXXNotFoundException is to be consistent with ClientRMServices. Thanks!
          Hide
          mitdesai Mit Desai added a comment -

          We can capture XXXXNotFoundException and convert it to webapp.NotFoundException

          Zhijie Shen How about we just return a null if the entity == null in ApplicationHistoryManagerOnTimelineStore? That way, when the call returns to WebServices, it will throw NotFoundException form its current implementation. This is the exact same approach that is used in the patch that I submitted earlier

          Show
          mitdesai Mit Desai added a comment - We can capture XXXXNotFoundException and convert it to webapp.NotFoundException Zhijie Shen How about we just return a null if the entity == null in ApplicationHistoryManagerOnTimelineStore? That way, when the call returns to WebServices, it will throw NotFoundException form its current implementation. This is the exact same approach that is used in the patch that I submitted earlier
          Hide
          jeagles Jonathan Eagles added a comment -

          FYI: Here is the config that was causing the original failure. Notice the newline as part of the value.

          <property>
          <description>Store class name for history store, defaulting to file system store</description>
          <name>yarn.timeline-service.generic-application-history.store-class</name>
          <value>org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore
          </value>
          </property>

          Internal System Error is still happens with ApplicationHistoryManagerOnTimelineStore which this issues now tracks.

          Show
          jeagles Jonathan Eagles added a comment - FYI: Here is the config that was causing the original failure. Notice the newline as part of the value. <property> <description>Store class name for history store, defaulting to file system store</description> <name>yarn.timeline-service.generic-application-history.store-class</name> <value>org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore </value> </property> Internal System Error is still happens with ApplicationHistoryManagerOnTimelineStore which this issues now tracks.
          Hide
          zjshen Zhijie Shen added a comment -

          Issue is spacing in the config file. Here is the updated stack trace.

          Then, this log message was expected when the app is not found. But INTERNAL_SERVER_ERROR is bad. We should return NOT_FOUND instead. We can capture XXXXNotFoundException and convert it to webapp.NotFoundException.

          Show
          zjshen Zhijie Shen added a comment - Issue is spacing in the config file. Here is the updated stack trace. Then, this log message was expected when the app is not found. But INTERNAL_SERVER_ERROR is bad. We should return NOT_FOUND instead. We can capture XXXXNotFoundException and convert it to webapp.NotFoundException.
          Hide
          zjshen Zhijie Shen added a comment -

          This is my setup, which I believe is a supported configuration for 2.6.0.

          Yeah, the configuration should be supported. However, with the configuration, ApplicationHistoryManagerOnTimelineStore should be used instead. Here's the related code in ApplicationHistoryServer.

            private ApplicationHistoryManager createApplicationHistoryManager(
                Configuration conf) {
              // Backward compatibility:
              // APPLICATION_HISTORY_STORE is neither null nor empty, it means that the
              // user has enabled it explicitly.
              if (conf.get(YarnConfiguration.APPLICATION_HISTORY_STORE) == null ||
                  conf.get(YarnConfiguration.APPLICATION_HISTORY_STORE).length() == 0 ||
                  conf.get(YarnConfiguration.APPLICATION_HISTORY_STORE).equals(
                      NullApplicationHistoryStore.class.getName())) {
                return new ApplicationHistoryManagerOnTimelineStore(
                    timelineDataManager, aclsManager);
              } else {
                LOG.warn("The filesystem based application history store is deprecated.");
                return new ApplicationHistoryManagerImpl();
              }
            }
          

          I tested this config locally. It seems that the new ApplicationHistoryManagerOnTimelineStore was picked. If it doesn't pick the right manager, then it is really bad.

          But given ApplicationHistoryManagerOnTimelineStore is picked, we shouldn't see NPE exception in the description.

          Show
          zjshen Zhijie Shen added a comment - This is my setup, which I believe is a supported configuration for 2.6.0. Yeah, the configuration should be supported. However, with the configuration, ApplicationHistoryManagerOnTimelineStore should be used instead. Here's the related code in ApplicationHistoryServer. private ApplicationHistoryManager createApplicationHistoryManager( Configuration conf) { // Backward compatibility: // APPLICATION_HISTORY_STORE is neither null nor empty, it means that the // user has enabled it explicitly. if (conf.get(YarnConfiguration.APPLICATION_HISTORY_STORE) == null || conf.get(YarnConfiguration.APPLICATION_HISTORY_STORE).length() == 0 || conf.get(YarnConfiguration.APPLICATION_HISTORY_STORE).equals( NullApplicationHistoryStore.class.getName())) { return new ApplicationHistoryManagerOnTimelineStore( timelineDataManager, aclsManager); } else { LOG.warn( "The filesystem based application history store is deprecated." ); return new ApplicationHistoryManagerImpl(); } } I tested this config locally. It seems that the new ApplicationHistoryManagerOnTimelineStore was picked. If it doesn't pick the right manager, then it is really bad. But given ApplicationHistoryManagerOnTimelineStore is picked, we shouldn't see NPE exception in the description.
          Hide
          jeagles Jonathan Eagles added a comment -

          Issue is spacing in the config file. Here is the updated stack trace.

          2014-11-24 22:34:53,900 [17694135@qtp-11347161-6] WARN webapp.GenericExceptionHandler: INTERNAL_SERVER_ERROR
          javax.ws.rs.WebApplicationException: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: The entity for application application_1416586084624_0011 doesn't exist in the timeline store
          at org.apache.hadoop.yarn.server.webapp.WebServices.rewrapAndThrowException(WebServices.java:452)
          at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:227)
          at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSWebServices.getApp(AHSWebServices.java:95)
          ....
          Caused by: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: The entity for application application_1416586084624_0011 doesn't exist in the timeline store
          at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.getApplication(ApplicationHistoryManagerOnTimelineStore.java:542)
          at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.getApplication(ApplicationHistoryManagerOnTimelineStore.java:94)
          at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:222)
          at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:219)
          at java.security.AccessController.doPrivileged(Native Method)
          at javax.security.auth.Subject.doAs(Subject.java:415)
          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1679)
          at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:218)
          ... 59 more

          Show
          jeagles Jonathan Eagles added a comment - Issue is spacing in the config file. Here is the updated stack trace. 2014-11-24 22:34:53,900 [17694135@qtp-11347161-6] WARN webapp.GenericExceptionHandler: INTERNAL_SERVER_ERROR javax.ws.rs.WebApplicationException: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: The entity for application application_1416586084624_0011 doesn't exist in the timeline store at org.apache.hadoop.yarn.server.webapp.WebServices.rewrapAndThrowException(WebServices.java:452) at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:227) at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSWebServices.getApp(AHSWebServices.java:95) .... Caused by: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: The entity for application application_1416586084624_0011 doesn't exist in the timeline store at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.getApplication(ApplicationHistoryManagerOnTimelineStore.java:542) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.getApplication(ApplicationHistoryManagerOnTimelineStore.java:94) at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:222) at org.apache.hadoop.yarn.server.webapp.WebServices$2.run(WebServices.java:219) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1679) at org.apache.hadoop.yarn.server.webapp.WebServices.getApp(WebServices.java:218) ... 59 more
          Hide
          jeagles Jonathan Eagles added a comment -

          I do see this in the log file that is suspicious now that I am looking at the code.

          2014-11-24 22:12:42,107 [main] WARN applicationhistoryservice.ApplicationHistoryServer: The filesystem based application history store is deprecated.

          Looking into this.

          Show
          jeagles Jonathan Eagles added a comment - I do see this in the log file that is suspicious now that I am looking at the code. 2014-11-24 22:12:42,107 [main] WARN applicationhistoryservice.ApplicationHistoryServer: The filesystem based application history store is deprecated. Looking into this.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12683426/YARN-2900.patch
          against trunk revision 2967c17.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5926//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5926//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12683426/YARN-2900.patch against trunk revision 2967c17. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5926//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5926//console This message is automatically generated.
          Hide
          jeagles Jonathan Eagles added a comment -

          Zhijie Shen, please don't jump to any conclusions. This is my setup, which I believe is a supported configuration for 2.6.0.

          yarn.timeline-service.generic-application-history.enabled=false
          yarn.timeline-service.generic-application-history.store-class=org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore

          The Tez UI make applicationhistory rest api calls to gather fine details for those who have it enabled. In my case where generic history is disabled, it is causing massive flooding of log files.

          As far as not finding the duplicate JIRA, I was unable to find this issue in the search. Try to include details that are searchable (stack track, logs, class/file names) so that users are able to find the appropriate issue.

          Show
          jeagles Jonathan Eagles added a comment - Zhijie Shen , please don't jump to any conclusions. This is my setup, which I believe is a supported configuration for 2.6.0. yarn.timeline-service.generic-application-history.enabled=false yarn.timeline-service.generic-application-history.store-class=org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore The Tez UI make applicationhistory rest api calls to gather fine details for those who have it enabled. In my case where generic history is disabled, it is causing massive flooding of log files. As far as not finding the duplicate JIRA, I was unable to find this issue in the search. Try to include details that are searchable (stack track, logs, class/file names) so that users are able to find the appropriate issue.
          Hide
          mitdesai Mit Desai added a comment -

          Attaching the patch that checks for null and returns appropriate result so that we can catch the NotFoundException in WebServices.java

          Show
          mitdesai Mit Desai added a comment - Attaching the patch that checks for null and returns appropriate result so that we can catch the NotFoundException in WebServices.java
          Hide
          zjshen Zhijie Shen added a comment -

          BTW, it's a known issue. and I've filed a ticket before: YARN-1835

          Show
          zjshen Zhijie Shen added a comment - BTW, it's a known issue. and I've filed a ticket before: YARN-1835
          Hide
          zjshen Zhijie Shen added a comment - - edited

          Jonathan Eagles, it seems that you're still using ApplicationHistoryManagerImpl and the old application history store.

          org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerImpl.convertToApplicationReport(ApplicationHistoryManagerImpl.java:128)
          

          Otherwise, you should see ApplicationHistoryManagerOnTimelineStore instead. Per discussion in YARN-2033, we will no longer support the old storage stack.

          Show
          zjshen Zhijie Shen added a comment - - edited Jonathan Eagles , it seems that you're still using ApplicationHistoryManagerImpl and the old application history store. org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerImpl.convertToApplicationReport(ApplicationHistoryManagerImpl.java:128) Otherwise, you should see ApplicationHistoryManagerOnTimelineStore instead. Per discussion in YARN-2033 , we will no longer support the old storage stack.
          Hide
          jeagles Jonathan Eagles added a comment -

          Application not found in the history store should be a normal case and not an exceptional in the REST api case since the application id is user provided information.

          Show
          jeagles Jonathan Eagles added a comment - Application not found in the history store should be a normal case and not an exceptional in the REST api case since the application id is user provided information.

            People

            • Assignee:
              mitdesai Mit Desai
              Reporter:
              jeagles Jonathan Eagles
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development