Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6698

Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: jobhistoryserver
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser is added to verify the fix of MAPREDUCE-6684 works. When two thread are requesting different jobs owned by the same user, one thread request jobA should not be blocked by the other that is processing a large job jobB. The timeout exception, if happened, should ideally indicate the fix does not work. But the timeout period is set too aggressive, so the test always fails on slow VMs.

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          ABORTED: Integrated in Hadoop-trunk-Commit #9793 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9793/)
          MAPREDUCE-6698. Increase timeout on (jlowe: rev 34fddd1e912dcd9f898e500b8df11295ee49c0d8)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestUnnecessaryBlockingOnHistoryFileInfo.java
          Show
          hudson Hudson added a comment - ABORTED: Integrated in Hadoop-trunk-Commit #9793 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9793/ ) MAPREDUCE-6698 . Increase timeout on (jlowe: rev 34fddd1e912dcd9f898e500b8df11295ee49c0d8) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestUnnecessaryBlockingOnHistoryFileInfo.java
          Hide
          jlowe Jason Lowe added a comment -

          Thanks, Haibo Chen! I committed this to trunk, branch-2, and branch-2.8.

          Show
          jlowe Jason Lowe added a comment - Thanks, Haibo Chen ! I committed this to trunk, branch-2, and branch-2.8.
          Hide
          jlowe Jason Lowe added a comment -

          TestUnnecessaryBlockingOnHistoryFileInfo doesn't exist in branch-2.7. Adjusting the affects/target versions accordingly.

          Show
          jlowe Jason Lowe added a comment - TestUnnecessaryBlockingOnHistoryFileInfo doesn't exist in branch-2.7. Adjusting the affects/target versions accordingly.
          Hide
          jlowe Jason Lowe added a comment -

          +1 lgtm. Committing this.

          Show
          jlowe Jason Lowe added a comment - +1 lgtm. Committing this.
          Hide
          haibochen Haibo Chen added a comment -

          Nothing related to this simple patch. Mostly java 1.8 issues.

          Show
          haibochen Haibo Chen added a comment - Nothing related to this simple patch. Mostly java 1.8 issues.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 11s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          -1 mvninstall 0m 7s root in trunk failed.
          +1 compile 0m 23s trunk passed with JDK v1.8.0_91
          -1 compile 0m 8s hadoop-mapreduce-client-hs in trunk failed with JDK v1.7.0_101.
          +1 checkstyle 0m 12s trunk passed
          -1 mvnsite 0m 9s hadoop-mapreduce-client-hs in trunk failed.
          +1 mvneclipse 0m 10s trunk passed
          -1 findbugs 0m 7s hadoop-mapreduce-client-hs in trunk failed.
          +1 javadoc 0m 13s trunk passed with JDK v1.8.0_91
          +1 javadoc 0m 13s trunk passed with JDK v1.7.0_101
          -1 mvninstall 0m 8s hadoop-mapreduce-client-hs in the patch failed.
          +1 compile 0m 17s the patch passed with JDK v1.8.0_91
          +1 javac 0m 17s the patch passed
          -1 compile 0m 8s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_101.
          -1 javac 0m 8s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_101.
          +1 checkstyle 0m 12s the patch passed
          -1 mvnsite 0m 9s hadoop-mapreduce-client-hs in the patch failed.
          +1 mvneclipse 0m 11s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          -1 findbugs 0m 7s hadoop-mapreduce-client-hs in the patch failed.
          +1 javadoc 0m 10s the patch passed with JDK v1.8.0_91
          +1 javadoc 0m 13s the patch passed with JDK v1.7.0_101
          -1 unit 5m 51s hadoop-mapreduce-client-hs in the patch failed with JDK v1.8.0_91.
          -1 unit 0m 7s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_101.
          +1 asflicense 0m 18s Patch does not generate ASF License warnings.
          10m 24s



          Reason Tests
          JDK v1.8.0_91 Failed junit tests hadoop.mapreduce.v2.hs.TestJobHistoryParsing
            hadoop.mapreduce.v2.hs.TestJobHistoryEntities
            hadoop.mapreduce.v2.hs.TestJobHistoryServer
            hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo
            hadoop.mapreduce.v2.hs.TestJobHistoryEvents



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:cf2ee45
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804299/mapreduce6698.001.patch
          JIRA Issue MAPREDUCE-6698
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 375ac5b708a4 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 6a6e74a
          Default Java 1.7.0_101
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_101
          mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-mvninstall-root.txt
          compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt
          mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt
          findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt
          mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-mvninstall-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt
          compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt
          javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt
          mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt
          findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_91.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt
          unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_91.txt
          JDK v1.7.0_101 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/testReport/
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs U: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 11s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvninstall 0m 7s root in trunk failed. +1 compile 0m 23s trunk passed with JDK v1.8.0_91 -1 compile 0m 8s hadoop-mapreduce-client-hs in trunk failed with JDK v1.7.0_101. +1 checkstyle 0m 12s trunk passed -1 mvnsite 0m 9s hadoop-mapreduce-client-hs in trunk failed. +1 mvneclipse 0m 10s trunk passed -1 findbugs 0m 7s hadoop-mapreduce-client-hs in trunk failed. +1 javadoc 0m 13s trunk passed with JDK v1.8.0_91 +1 javadoc 0m 13s trunk passed with JDK v1.7.0_101 -1 mvninstall 0m 8s hadoop-mapreduce-client-hs in the patch failed. +1 compile 0m 17s the patch passed with JDK v1.8.0_91 +1 javac 0m 17s the patch passed -1 compile 0m 8s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_101. -1 javac 0m 8s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_101. +1 checkstyle 0m 12s the patch passed -1 mvnsite 0m 9s hadoop-mapreduce-client-hs in the patch failed. +1 mvneclipse 0m 11s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. -1 findbugs 0m 7s hadoop-mapreduce-client-hs in the patch failed. +1 javadoc 0m 10s the patch passed with JDK v1.8.0_91 +1 javadoc 0m 13s the patch passed with JDK v1.7.0_101 -1 unit 5m 51s hadoop-mapreduce-client-hs in the patch failed with JDK v1.8.0_91. -1 unit 0m 7s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_101. +1 asflicense 0m 18s Patch does not generate ASF License warnings. 10m 24s Reason Tests JDK v1.8.0_91 Failed junit tests hadoop.mapreduce.v2.hs.TestJobHistoryParsing   hadoop.mapreduce.v2.hs.TestJobHistoryEntities   hadoop.mapreduce.v2.hs.TestJobHistoryServer   hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo   hadoop.mapreduce.v2.hs.TestJobHistoryEvents Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804299/mapreduce6698.001.patch JIRA Issue MAPREDUCE-6698 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 375ac5b708a4 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 6a6e74a Default Java 1.7.0_101 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_101 mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-mvninstall-root.txt compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-mvninstall-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_91.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_101.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_91.txt JDK v1.7.0_101 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs U: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6503/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          haibochen Haibo Chen added a comment -

          The change is limited to the timeout value we set on the test. It is 20s now. The new value 10 mins should be sufficiently long.

          Show
          haibochen Haibo Chen added a comment - The change is limited to the timeout value we set on the test. It is 20s now. The new value 10 mins should be sufficiently long.

            People

            • Assignee:
              haibochen Haibo Chen
              Reporter:
              haibochen Haibo Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development