Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4380

TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0, 2.7.1
    • Fix Version/s: 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 5.361 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
      testDownloadingResourcesOnContainerKill(org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService) Time elapsed: 0.109 sec <<< FAILURE!
      org.mockito.exceptions.verification.junit.ArgumentsAreDifferent:
      Argument(s) are different! Wanted:
      deletionService.delete(
      "user0",
      null,
      <Downloading paths matcher>
      );
      -> at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testDownloadingResourcesOnContainerKill(TestResourceLocalizationService.java:1322)
      Actual invocation has different arguments:
      deletionService.delete(
      "user0",
      /home/ubuntu/hadoop-dev/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/0/usercache/user0/appcache/application_314159265358979_0003/container_314159265358979_0003_01_000042
      );
      -> at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testDownloadingResourcesOnContainerKill(TestResourceLocalizationService.java:1296)

      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
      at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testDownloadingResourcesOnContainerKill(TestResourceLocalizationService.java:1322)

        Issue Links

          Activity

          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Closing the JIRA as part of 2.7.3 release.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Closing the JIRA as part of 2.7.3 release.
          Hide
          djp Junping Du added a comment -

          Per Varun's comments in YARN-2902, I have cherry-pick this patch together with YARN-2902 to branch-2.6.

          Show
          djp Junping Du added a comment - Per Varun's comments in YARN-2902 , I have cherry-pick this patch together with YARN-2902 to branch-2.6.
          Hide
          varun_saxena Varun Saxena added a comment -

          Thanks Tsuyoshi Ozawa for the commit

          Show
          varun_saxena Varun Saxena added a comment - Thanks Tsuyoshi Ozawa for the commit
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2580 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2580/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2580 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2580/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #723 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/723/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #723 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/723/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Hide
          hudson Hudson added a comment -

          ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #643 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/643/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Show
          hudson Hudson added a comment - ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #643 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/643/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1454 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1454/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1454 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1454/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #733 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/733/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #733 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/733/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2664 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2664/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2664 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2664/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Committed this to trunk, branch-2, and branch-2.7. Thanks Varun Saxena for your contribution.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Committed this to trunk, branch-2, and branch-2.7. Thanks Varun Saxena for your contribution.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8887 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8887/)
          YARN-4380. (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8887 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8887/ ) YARN-4380 . (ozawa: rev 0656d2dc83af6a48a8d8d0e37cdf1f813124f366) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          +1, checking this in.

          Show
          ozawa Tsuyoshi Ozawa added a comment - +1, checking this in.
          Hide
          varun_saxena Varun Saxena added a comment -

          Changed the JIRA title because this test can potentially fail intermittently on all branches.

          Show
          varun_saxena Varun Saxena added a comment - Changed the JIRA title because this test can potentially fail intermittently on all branches.
          Hide
          varun_saxena Varun Saxena added a comment -

          Tsuyoshi Ozawa, I have filed YARN-4393 for above test case failure

          Show
          varun_saxena Varun Saxena added a comment - Tsuyoshi Ozawa , I have filed YARN-4393 for above test case failure
          Hide
          varun_saxena Varun Saxena added a comment -

          Tsuyoshi Ozawa, checked the test failure.
          This issue is coming because we do not have any wait after sending DESTROY_APPLICATION_RESOURCES event. And we are immediately checking for APPLICATION_RESOURCES_CLEANEDUP event being sent by Resource Localization service(upon processing of DESTROY_APPLICATION_RESOURCES).

                LocalizationEvent destroyApp =
                    new ApplicationLocalizationEvent(
                      LocalizationEventType.DESTROY_APPLICATION_RESOURCES, app);
                spyService.handle(destroyApp);
                verify(applicationBus).handle(argThat(matchesAppDestroy));
          

          Adding a dispatcher.await() statement in between spyService.handle and verify statement will resolve the issue.
          This test case is broken by YARN-90 and not YARN-2902. So we should raise another JIRA for it. As you found the issue, you can raise the JIRA and assign it to me. I will update a patch there.

          Show
          varun_saxena Varun Saxena added a comment - Tsuyoshi Ozawa , checked the test failure. This issue is coming because we do not have any wait after sending DESTROY_APPLICATION_RESOURCES event. And we are immediately checking for APPLICATION_RESOURCES_CLEANEDUP event being sent by Resource Localization service(upon processing of DESTROY_APPLICATION_RESOURCES). LocalizationEvent destroyApp = new ApplicationLocalizationEvent( LocalizationEventType.DESTROY_APPLICATION_RESOURCES, app); spyService.handle(destroyApp); verify(applicationBus).handle(argThat(matchesAppDestroy)); Adding a dispatcher.await() statement in between spyService.handle and verify statement will resolve the issue. This test case is broken by YARN-90 and not YARN-2902 . So we should raise another JIRA for it. As you found the issue, you can raise the JIRA and assign it to me. I will update a patch there.
          Hide
          varun_saxena Varun Saxena added a comment -

          Ok. Will have a look.

          Show
          varun_saxena Varun Saxena added a comment - Ok. Will have a look.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Varun Saxena, thank you for the fix. The fix itself looks good me.

          I got another error though it's rare to happen:

          Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 5.518 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
          testFailedDirsResourceRelease(org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService) Time elapsed: 0.093 sec <<< FAILURE!
          org.mockito.exceptions.verification.junit.ArgumentsAreDifferent:
          Argument(s) are different! Wanted:
          eventHandler.handle(
          <custom argument matcher>
          );
          -> at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testFailedDirsResourceRelease(TestResourceLocalizationService.java:2632)
          Actual invocation has different arguments:
          eventHandler.handle(
          EventType: APPLICATION_INITED
          );
          -> at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)

          at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
          at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
          at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
          at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
          at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testFailedDirsResourceRelease(TestResourceLocalizationService.java:2632)

          Attaching a log for the failure. Could you take a look?

          Show
          ozawa Tsuyoshi Ozawa added a comment - Varun Saxena , thank you for the fix. The fix itself looks good me. I got another error though it's rare to happen: Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 5.518 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService testFailedDirsResourceRelease(org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService) Time elapsed: 0.093 sec <<< FAILURE! org.mockito.exceptions.verification.junit.ArgumentsAreDifferent: Argument(s) are different! Wanted: eventHandler.handle( <custom argument matcher> ); -> at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testFailedDirsResourceRelease(TestResourceLocalizationService.java:2632) Actual invocation has different arguments: eventHandler.handle( EventType: APPLICATION_INITED ); -> at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:183) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testFailedDirsResourceRelease(TestResourceLocalizationService.java:2632) Attaching a log for the failure. Could you take a look?
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          -1 mvninstall 1m 59s root in trunk failed.
          +1 compile 0m 26s trunk passed with JDK v1.8.0_66
          +1 compile 0m 25s trunk passed with JDK v1.7.0_85
          +1 checkstyle 0m 11s trunk passed
          +1 mvnsite 0m 27s trunk passed
          +1 mvneclipse 0m 10s trunk passed
          +1 findbugs 0m 54s trunk passed
          +1 javadoc 0m 16s trunk passed with JDK v1.8.0_66
          +1 javadoc 0m 19s trunk passed with JDK v1.7.0_85
          -1 mvninstall 0m 24s hadoop-yarn-server-nodemanager in the patch failed.
          +1 compile 0m 24s the patch passed with JDK v1.8.0_66
          +1 javac 0m 24s the patch passed
          +1 compile 0m 26s the patch passed with JDK v1.7.0_85
          +1 javac 0m 26s the patch passed
          +1 checkstyle 0m 11s the patch passed
          +1 mvnsite 0m 26s the patch passed
          +1 mvneclipse 0m 10s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 1m 0s the patch passed
          +1 javadoc 0m 15s the patch passed with JDK v1.8.0_66
          +1 javadoc 0m 19s the patch passed with JDK v1.7.0_85
          +1 unit 8m 22s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_66.
          +1 unit 8m 51s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_85.
          +1 asflicense 0m 23s Patch does not generate ASF License warnings.
          27m 11s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12773897/YARN-4380.01.patch
          JIRA Issue YARN-4380
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 983711f1122c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / d36b6e0
          mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/9772/artifact/patchprocess/branch-mvninstall-root.txt
          findbugs v3.0.0
          mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/9772/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
          JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9772/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager
          Max memory used 46MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9772/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvninstall 1m 59s root in trunk failed. +1 compile 0m 26s trunk passed with JDK v1.8.0_66 +1 compile 0m 25s trunk passed with JDK v1.7.0_85 +1 checkstyle 0m 11s trunk passed +1 mvnsite 0m 27s trunk passed +1 mvneclipse 0m 10s trunk passed +1 findbugs 0m 54s trunk passed +1 javadoc 0m 16s trunk passed with JDK v1.8.0_66 +1 javadoc 0m 19s trunk passed with JDK v1.7.0_85 -1 mvninstall 0m 24s hadoop-yarn-server-nodemanager in the patch failed. +1 compile 0m 24s the patch passed with JDK v1.8.0_66 +1 javac 0m 24s the patch passed +1 compile 0m 26s the patch passed with JDK v1.7.0_85 +1 javac 0m 26s the patch passed +1 checkstyle 0m 11s the patch passed +1 mvnsite 0m 26s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 1m 0s the patch passed +1 javadoc 0m 15s the patch passed with JDK v1.8.0_66 +1 javadoc 0m 19s the patch passed with JDK v1.7.0_85 +1 unit 8m 22s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_66. +1 unit 8m 51s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_85. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 27m 11s Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12773897/YARN-4380.01.patch JIRA Issue YARN-4380 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 983711f1122c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / d36b6e0 mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/9772/artifact/patchprocess/branch-mvninstall-root.txt findbugs v3.0.0 mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/9772/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9772/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager Max memory used 46MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/9772/console This message was automatically generated.
          Hide
          varun_saxena Varun Saxena added a comment -

          Check for localizer runner thread to finish should be enough for the test to pass.
          But to avoid InterruptedException in logs(due to race), have added check for localization to begin as well before initiating localizer heartbeats in test.

          Show
          varun_saxena Varun Saxena added a comment - Check for localizer runner thread to finish should be enough for the test to pass. But to avoid InterruptedException in logs(due to race), have added check for localization to begin as well before initiating localizer heartbeats in test.
          Hide
          varun_saxena Varun Saxena added a comment -

          Thanks Tsuyoshi Ozawa.
          InterruptedException indicates that there is a race. Because LocalizerRunner#interrupt has been called while credential file is being written.

          Show
          varun_saxena Varun Saxena added a comment - Thanks Tsuyoshi Ozawa . InterruptedException indicates that there is a race. Because LocalizerRunner#interrupt has been called while credential file is being written.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Varun Saxena attaching a log when the test fails.

          I use this simple script to reproduce some intermittent failures https://github.com/oza/failchecker

          Show
          ozawa Tsuyoshi Ozawa added a comment - Varun Saxena attaching a log when the test fails. I use this simple script to reproduce some intermittent failures https://github.com/oza/failchecker
          Hide
          varun_saxena Varun Saxena added a comment -

          Thanks for reporting this Tsuyoshi Ozawa. I tried running this test several times on branch-2 but could not simulate the failure.
          If you are able to simulate, it will be helpful if you can share the logs.

          Show
          varun_saxena Varun Saxena added a comment - Thanks for reporting this Tsuyoshi Ozawa . I tried running this test several times on branch-2 but could not simulate the failure. If you are able to simulate, it will be helpful if you can share the logs.
          Hide
          jlowe Jason Lowe added a comment -

          Varun Saxena could you take a look?

          Show
          jlowe Jason Lowe added a comment - Varun Saxena could you take a look?

            People

            • Assignee:
              varun_saxena Varun Saxena
              Reporter:
              ozawa Tsuyoshi Ozawa
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development