Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4320

TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 2.7.2, 2.6.3, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
      Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 40.256 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
      testTimelineEventHandling(org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler)  Time elapsed: 35.764 sec  <<< ERROR!
      java.lang.RuntimeException: Failed to connect to timeline server. Connection retries limit exceeded. The posted timeline event may be missing
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$TimelineClientConnectionRetry.retryOn(TimelineClientImpl.java:206)
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$TimelineJerseyRetryFilter.handle(TimelineClientImpl.java:245)
      	at com.sun.jersey.api.client.Client.handle(Client.java:648)
      	at com.sun.jersey.api.client.WebResource.handle(WebResource.java:670)
      	at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
      	at com.sun.jersey.api.client.WebResource$Builder.post(WebResource.java:563)
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.doPostingObject(TimelineClientImpl.java:474)
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$1.run(TimelineClientImpl.java:323)
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$1.run(TimelineClientImpl.java:320)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:415)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669)
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.doPosting(TimelineClientImpl.java:320)
      	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:305)
      	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.processEventForTimelineServer(JobHistoryEventHandler.java:1015)
      	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.handleEvent(JobHistoryEventHandler.java:586)
      	at org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler.handleEvent(TestJobHistoryEventHandler.java:719)
      	at org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler.testTimelineEventHandling(TestJobHistoryEventHandler.java:507)
      

        Issue Links

          Activity

          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Thanks for committing this to branch-2.6, Sangjin!

          Show
          ozawa Tsuyoshi Ozawa added a comment - Thanks for committing this to branch-2.6, Sangjin!
          Hide
          sjlee0 Sangjin Lee added a comment -

          Committed it to branch-2.6 too.

          Show
          sjlee0 Sangjin Lee added a comment - Committed it to branch-2.6 too.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #555 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/555/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #555 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/555/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java hadoop-yarn-project/CHANGES.txt
          Hide
          varun_saxena Varun Saxena added a comment -

          Thanks Tsuyoshi Ozawa for the review and commit.

          Show
          varun_saxena Varun Saxena added a comment - Thanks Tsuyoshi Ozawa for the review and commit.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2492 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2492/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2492 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2492/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #618 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/618/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #618 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/618/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2548 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2548/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2548 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2548/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1341 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1341/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1341 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1341/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #606 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/606/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #606 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/606/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8729 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8729/)
          YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8729 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8729/ ) YARN-4320 . TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no (ozawa: rev ce31b22739512804da38cf87e0ce1059e3128da3) hadoop-yarn-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Committed this to trunk, branch-2, and branch-2.7. Thanks Varun Saxena for your contribution.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Committed this to trunk, branch-2, and branch-2.7. Thanks Varun Saxena for your contribution.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          +1, checking this in.

          Show
          ozawa Tsuyoshi Ozawa added a comment - +1, checking this in.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 7s docker + precommit patch detected.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 3m 8s trunk passed
          +1 compile 4m 21s trunk passed with JDK v1.8.0_60
          +1 compile 4m 6s trunk passed with JDK v1.7.0_79
          +1 checkstyle 0m 55s trunk passed
          +1 mvneclipse 0m 28s trunk passed
          +1 findbugs 1m 17s trunk passed
          +1 javadoc 0m 32s trunk passed with JDK v1.8.0_60
          +1 javadoc 0m 36s trunk passed with JDK v1.7.0_79
          +1 mvninstall 0m 40s the patch passed
          +1 compile 4m 20s the patch passed with JDK v1.8.0_60
          +1 javac 4m 20s the patch passed
          +1 compile 4m 17s the patch passed with JDK v1.7.0_79
          +1 javac 4m 17s the patch passed
          +1 checkstyle 1m 0s the patch passed
          +1 mvneclipse 0m 27s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 1m 35s the patch passed
          +1 javadoc 0m 31s the patch passed with JDK v1.8.0_60
          +1 javadoc 0m 35s the patch passed with JDK v1.7.0_79
          +1 unit 3m 0s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_60.
          +1 unit 8m 56s hadoop-mapreduce-client-app in the patch passed with JDK v1.8.0_60.
          +1 unit 3m 5s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_79.
          +1 unit 9m 30s hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_79.
          -1 asflicense 0m 24s Patch generated 7 ASF License warnings.
          54m 57s



          Subsystem Report/Notes
          Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-30
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769656/YARN-4320.01.patch
          JIRA Issue YARN-4320
          Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile
          uname Linux d0d16fc7b2c6 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/apache-yetus-e77b1ce/precommit/personality/hadoop.sh
          git revision trunk / 7412ff4
          Default Java 1.7.0_79
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
          findbugs v3.0.0
          JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9604/testReport/
          asflicense https://builds.apache.org/job/PreCommit-YARN-Build/9604/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice U: .
          Max memory used 228MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9604/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 7s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 3m 8s trunk passed +1 compile 4m 21s trunk passed with JDK v1.8.0_60 +1 compile 4m 6s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 55s trunk passed +1 mvneclipse 0m 28s trunk passed +1 findbugs 1m 17s trunk passed +1 javadoc 0m 32s trunk passed with JDK v1.8.0_60 +1 javadoc 0m 36s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 40s the patch passed +1 compile 4m 20s the patch passed with JDK v1.8.0_60 +1 javac 4m 20s the patch passed +1 compile 4m 17s the patch passed with JDK v1.7.0_79 +1 javac 4m 17s the patch passed +1 checkstyle 1m 0s the patch passed +1 mvneclipse 0m 27s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 1m 35s the patch passed +1 javadoc 0m 31s the patch passed with JDK v1.8.0_60 +1 javadoc 0m 35s the patch passed with JDK v1.7.0_79 +1 unit 3m 0s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_60. +1 unit 8m 56s hadoop-mapreduce-client-app in the patch passed with JDK v1.8.0_60. +1 unit 3m 5s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_79. +1 unit 9m 30s hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_79. -1 asflicense 0m 24s Patch generated 7 ASF License warnings. 54m 57s Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-30 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769656/YARN-4320.01.patch JIRA Issue YARN-4320 Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile uname Linux d0d16fc7b2c6 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/apache-yetus-e77b1ce/precommit/personality/hadoop.sh git revision trunk / 7412ff4 Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 findbugs v3.0.0 JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9604/testReport/ asflicense https://builds.apache.org/job/PreCommit-YARN-Build/9604/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice U: . Max memory used 228MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/9604/console This message was automatically generated.

            People

            • Assignee:
              varun_saxena Varun Saxena
              Reporter:
              varun_saxena Varun Saxena
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development