Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9435

TestBlockRecovery#testRBWReplicas is failing intermittently

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      TestBlockRecovery#testRBWReplicas is failing in the build 13536. It looks like bug in tests due to race condition.

      Note: Attached logs taken from the build to this jira.

      1. HDFS-9435-00.patch
        1.0 kB
        Rakesh R
      2. HDFS-9435-01.patch
        1 kB
        Rakesh R
      3. HDFS-9435-02.patch
        1 kB
        Rakesh R
      4. HDFS-9435-03.patch
        2 kB
        Rakesh R
      5. testRBWReplicas.log
        17 kB
        Rakesh R

        Activity

        Hide
        rakeshr Rakesh R added a comment -

        It looks like there is a race between this waiting period and BPServiceActor#scheduleNextHeartbeat() call by BPServiceActor#offerService().

          void triggerHeartbeatForTests() {
            synchronized (pendingIncrementalBRperStorage) {
              final long nextHeartbeatTime = scheduler.scheduleHeartbeat();
              pendingIncrementalBRperStorage.notifyAll();
              while (nextHeartbeatTime - scheduler.nextHeartbeatTime >= 0) {
                try {
                  pendingIncrementalBRperStorage.wait(100);
                } catch (InterruptedException e) {
                  return;
                }
              }
            }
          }
        

        Execution Sequence results in test case failure:-

        1=> During starts, its calling dn.getAllBpOs().get(0).triggerHeartbeatForTests() and initializing final long nextHeartbeatTime = scheduler.scheduleHeartbeat();
        2=> BPServiceActor#offerService()
        3=> BPServiceActor#sendHeartBeat()
        4=> BPServiceActor.scheduler.scheduleNextHeartbeat()
        5=> Now, immediately nextHeartbeatTime - scheduler.nextHeartbeatTime >= 0 satisifies and #triggerHeartbeatForTests() stops waiting period and starts unit testing.
        6=> During tests, it will try to get BlockRecoveryWorker#getActiveNamenodeForBP() and see null ActiveNN, then throws exception. Because BPServiceActor#offerService() execution is still in progress and not yet updated the ActiveNN.

            DatanodeProtocolClientSideTranslatorPB activeNN = bpos.getActiveNN();
            if (activeNN == null) {
              throw new IOException(
                  "Block pool " + bpid + " has not recognized an active NN");
            }
        
        Show
        rakeshr Rakesh R added a comment - It looks like there is a race between this waiting period and BPServiceActor#scheduleNextHeartbeat() call by BPServiceActor#offerService(). void triggerHeartbeatForTests() { synchronized (pendingIncrementalBRperStorage) { final long nextHeartbeatTime = scheduler.scheduleHeartbeat(); pendingIncrementalBRperStorage.notifyAll(); while (nextHeartbeatTime - scheduler.nextHeartbeatTime >= 0) { try { pendingIncrementalBRperStorage.wait(100); } catch (InterruptedException e) { return ; } } } } Execution Sequence results in test case failure:- 1=> During starts, its calling dn.getAllBpOs().get(0).triggerHeartbeatForTests() and initializing final long nextHeartbeatTime = scheduler.scheduleHeartbeat(); 2=> BPServiceActor#offerService() 3=> BPServiceActor#sendHeartBeat() 4=> BPServiceActor.scheduler.scheduleNextHeartbeat() 5=> Now, immediately nextHeartbeatTime - scheduler.nextHeartbeatTime >= 0 satisifies and #triggerHeartbeatForTests() stops waiting period and starts unit testing. 6=> During tests, it will try to get BlockRecoveryWorker#getActiveNamenodeForBP() and see null ActiveNN, then throws exception. Because BPServiceActor#offerService() execution is still in progress and not yet updated the ActiveNN. DatanodeProtocolClientSideTranslatorPB activeNN = bpos.getActiveNN(); if (activeNN == null ) { throw new IOException( "Block pool " + bpid + " has not recognized an active NN" ); }
        Hide
        rakeshr Rakesh R added a comment -

        Attached simple fix by giving grace period to see not null #getActiveNN() in the tests. Please review the analysis and the fix. Thanks!

        Show
        rakeshr Rakesh R added a comment - Attached simple fix by giving grace period to see not null #getActiveNN() in the tests. Please review the analysis and the fix. Thanks!
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 8s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 3m 24s trunk passed
        +1 compile 0m 40s trunk passed with JDK v1.8.0_66
        +1 compile 0m 37s trunk passed with JDK v1.7.0_79
        +1 checkstyle 0m 18s trunk passed
        +1 mvnsite 0m 50s trunk passed
        +1 mvneclipse 0m 16s trunk passed
        +1 findbugs 2m 16s trunk passed
        +1 javadoc 1m 24s trunk passed with JDK v1.8.0_66
        +1 javadoc 2m 10s trunk passed with JDK v1.7.0_79
        +1 mvninstall 0m 46s the patch passed
        +1 compile 0m 41s the patch passed with JDK v1.8.0_66
        +1 javac 0m 41s the patch passed
        +1 compile 0m 38s the patch passed with JDK v1.7.0_79
        +1 javac 0m 38s the patch passed
        +1 checkstyle 0m 18s the patch passed
        +1 mvnsite 0m 49s the patch passed
        +1 mvneclipse 0m 16s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 22s the patch passed
        +1 javadoc 1m 22s the patch passed with JDK v1.8.0_66
        +1 javadoc 2m 26s the patch passed with JDK v1.7.0_79
        -1 unit 88m 25s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 86m 44s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
        -1 asflicense 0m 26s Patch generated 56 ASF License warnings.
        200m 34s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.server.namenode.ha.TestDNFencing
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040
          hadoop.hdfs.server.namenode.TestINodeFile
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
          hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
          hadoop.hdfs.server.datanode.TestDirectoryScanner
        JDK v1.7.0_79 Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
          hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
          hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.TestRecoverStripedFile
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
          hadoop.hdfs.server.datanode.TestBlockReplacement
          hadoop.hdfs.TestEncryptionZones
          hadoop.hdfs.server.datanode.TestDirectoryScanner



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2015-11-17
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772776/HDFS-9435-00.patch
        JIRA Issue HDFS-9435
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux da8a4202ffc0 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-4659377/precommit/personality/hadoop.sh
        git revision trunk / b82a6ce
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13537/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 228MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13537/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 8s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 3m 24s trunk passed +1 compile 0m 40s trunk passed with JDK v1.8.0_66 +1 compile 0m 37s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 18s trunk passed +1 mvnsite 0m 50s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 2m 16s trunk passed +1 javadoc 1m 24s trunk passed with JDK v1.8.0_66 +1 javadoc 2m 10s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 46s the patch passed +1 compile 0m 41s the patch passed with JDK v1.8.0_66 +1 javac 0m 41s the patch passed +1 compile 0m 38s the patch passed with JDK v1.7.0_79 +1 javac 0m 38s the patch passed +1 checkstyle 0m 18s the patch passed +1 mvnsite 0m 49s the patch passed +1 mvneclipse 0m 16s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 22s the patch passed +1 javadoc 1m 22s the patch passed with JDK v1.8.0_66 +1 javadoc 2m 26s the patch passed with JDK v1.7.0_79 -1 unit 88m 25s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 86m 44s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 26s Patch generated 56 ASF License warnings. 200m 34s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040   hadoop.hdfs.server.namenode.TestINodeFile   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.server.datanode.TestDirectoryScanner JDK v1.7.0_79 Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.TestRecoverStripedFile   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-17 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772776/HDFS-9435-00.patch JIRA Issue HDFS-9435 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux da8a4202ffc0 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-4659377/precommit/personality/hadoop.sh git revision trunk / b82a6ce findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13537/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13537/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 228MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13537/console This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 10s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 3m 34s trunk passed
        +1 compile 0m 49s trunk passed with JDK v1.8.0_66
        +1 compile 0m 45s trunk passed with JDK v1.7.0_79
        +1 checkstyle 0m 21s trunk passed
        +1 mvnsite 1m 0s trunk passed
        +1 mvneclipse 0m 20s trunk passed
        +1 findbugs 2m 39s trunk passed
        +1 javadoc 1m 39s trunk passed with JDK v1.8.0_66
        +1 javadoc 2m 26s trunk passed with JDK v1.7.0_79
        +1 mvninstall 0m 58s the patch passed
        +1 compile 0m 55s the patch passed with JDK v1.8.0_66
        +1 javac 0m 55s the patch passed
        +1 compile 0m 47s the patch passed with JDK v1.7.0_79
        +1 javac 0m 47s the patch passed
        +1 checkstyle 0m 22s the patch passed
        +1 mvnsite 1m 0s the patch passed
        +1 mvneclipse 0m 18s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 38s the patch passed
        +1 javadoc 1m 30s the patch passed with JDK v1.8.0_66
        +1 javadoc 2m 25s the patch passed with JDK v1.7.0_79
        -1 unit 91m 49s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 83m 33s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
        -1 asflicense 0m 21s Patch generated 56 ASF License warnings.
        203m 58s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.TestCheckpoint
          hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.server.namenode.ha.TestDNFencing
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.server.datanode.TestBlockReplacement
          hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          hadoop.hdfs.TestEncryptionZones
          hadoop.hdfs.server.datanode.TestDirectoryScanner
        JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
          hadoop.hdfs.server.datanode.TestTransferRbw
          hadoop.hdfs.server.datanode.TestBlockReplacement
          hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          hadoop.hdfs.server.datanode.TestDirectoryScanner



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2015-11-17
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772779/HDFS-9435-01.patch
        JIRA Issue HDFS-9435
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 065ac136790e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build@2/patchprocess/apache-yetus-4659377/precommit/personality/hadoop.sh
        git revision trunk / b82a6ce
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13538/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 226MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13538/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 3m 34s trunk passed +1 compile 0m 49s trunk passed with JDK v1.8.0_66 +1 compile 0m 45s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 21s trunk passed +1 mvnsite 1m 0s trunk passed +1 mvneclipse 0m 20s trunk passed +1 findbugs 2m 39s trunk passed +1 javadoc 1m 39s trunk passed with JDK v1.8.0_66 +1 javadoc 2m 26s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 58s the patch passed +1 compile 0m 55s the patch passed with JDK v1.8.0_66 +1 javac 0m 55s the patch passed +1 compile 0m 47s the patch passed with JDK v1.7.0_79 +1 javac 0m 47s the patch passed +1 checkstyle 0m 22s the patch passed +1 mvnsite 1m 0s the patch passed +1 mvneclipse 0m 18s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 38s the patch passed +1 javadoc 1m 30s the patch passed with JDK v1.8.0_66 +1 javadoc 2m 25s the patch passed with JDK v1.7.0_79 -1 unit 91m 49s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 83m 33s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 21s Patch generated 56 ASF License warnings. 203m 58s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.TestCheckpoint   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.server.datanode.TestDirectoryScanner JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.hdfs.server.datanode.TestTransferRbw   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-17 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772779/HDFS-9435-01.patch JIRA Issue HDFS-9435 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 065ac136790e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build@2/patchprocess/apache-yetus-4659377/precommit/personality/hadoop.sh git revision trunk / b82a6ce findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13538/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13538/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 226MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13538/console This message was automatically generated.
        Hide
        iwasakims Masatake Iwasaki added a comment -

        Thanks for working on this, Rakesh R.

        I think your analysis is correct. triggerHeartbeatForTests is possible to return before HeartbeatResponse is processed. How about using triggerBlockReportForTests instead? It also triggers heartbeat and returns after HeartbeatResponse is processed. Calling triggerHeartbeatForTests twice might work too.

        If it turns out to need sleeps waiting for condition, GenericTestUtils#waitFor could be used.

        Show
        iwasakims Masatake Iwasaki added a comment - Thanks for working on this, Rakesh R . I think your analysis is correct. triggerHeartbeatForTests is possible to return before HeartbeatResponse is processed. How about using triggerBlockReportForTests instead? It also triggers heartbeat and returns after HeartbeatResponse is processed. Calling triggerHeartbeatForTests twice might work too. If it turns out to need sleeps waiting for condition, GenericTestUtils#waitFor could be used.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 5s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 7m 34s trunk passed
        +1 compile 0m 41s trunk passed with JDK v1.8.0_66
        +1 compile 0m 40s trunk passed with JDK v1.7.0_85
        +1 checkstyle 0m 15s trunk passed
        +1 mvnsite 0m 53s trunk passed
        +1 mvneclipse 0m 14s trunk passed
        +1 findbugs 1m 53s trunk passed
        +1 javadoc 1m 6s trunk passed with JDK v1.8.0_66
        +1 javadoc 1m 47s trunk passed with JDK v1.7.0_85
        +1 mvninstall 0m 47s the patch passed
        +1 compile 0m 41s the patch passed with JDK v1.8.0_66
        +1 javac 0m 41s the patch passed
        +1 compile 0m 41s the patch passed with JDK v1.7.0_85
        +1 javac 0m 41s the patch passed
        +1 checkstyle 0m 15s the patch passed
        +1 mvnsite 0m 52s the patch passed
        +1 mvneclipse 0m 14s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 3s the patch passed
        +1 javadoc 1m 4s the patch passed with JDK v1.8.0_66
        +1 javadoc 1m 49s the patch passed with JDK v1.7.0_85
        -1 unit 51m 28s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 49m 48s hadoop-hdfs in the patch failed with JDK v1.7.0_85.
        -1 asflicense 0m 19s Patch generated 58 ASF License warnings.
        127m 40s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
          hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
        JDK v1.7.0_85 Failed junit tests hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
          hadoop.hdfs.TestCrcCorruption



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2015-11-18
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772779/HDFS-9435-01.patch
        JIRA Issue HDFS-9435
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux f193c22b3b27 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh
        git revision trunk / 7fab5c8
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt
        JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13542/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 77MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13542/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 5s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 34s trunk passed +1 compile 0m 41s trunk passed with JDK v1.8.0_66 +1 compile 0m 40s trunk passed with JDK v1.7.0_85 +1 checkstyle 0m 15s trunk passed +1 mvnsite 0m 53s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 1m 53s trunk passed +1 javadoc 1m 6s trunk passed with JDK v1.8.0_66 +1 javadoc 1m 47s trunk passed with JDK v1.7.0_85 +1 mvninstall 0m 47s the patch passed +1 compile 0m 41s the patch passed with JDK v1.8.0_66 +1 javac 0m 41s the patch passed +1 compile 0m 41s the patch passed with JDK v1.7.0_85 +1 javac 0m 41s the patch passed +1 checkstyle 0m 15s the patch passed +1 mvnsite 0m 52s the patch passed +1 mvneclipse 0m 14s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 3s the patch passed +1 javadoc 1m 4s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 49s the patch passed with JDK v1.7.0_85 -1 unit 51m 28s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 49m 48s hadoop-hdfs in the patch failed with JDK v1.7.0_85. -1 asflicense 0m 19s Patch generated 58 ASF License warnings. 127m 40s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots JDK v1.7.0_85 Failed junit tests hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.TestCrcCorruption Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-18 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772779/HDFS-9435-01.patch JIRA Issue HDFS-9435 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux f193c22b3b27 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh git revision trunk / 7fab5c8 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13542/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13542/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 77MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13542/console This message was automatically generated.
        Hide
        rakeshr Rakesh R added a comment -

        Thanks Masatake Iwasaki for the interest and useful comments.

        I could see, again #triggerBlockReportForTests can immediately return before acknowledging the ActiveNN. Below is the sequence:

        1=> During startUp(), it will call dn.getAllBpOs().get(0).triggerBlockReportForTests() and initializes final long oldBlockReportTime = scheduler.nextBlockReportTime;
        2=> BPServiceActor#start().
        3=> Starting of the actor thread will call the function BPServiceActor#connectToNNAndHandshake()
        4=> BPServiceActor#register()
        5=> scheduler#scheduleBlockReport(dnConf.initialBlockReportDelayMs);
        Now, #scheduleBlockReport function call will update nextBlockReportTime = monotonicNow();. This will again stops waiting period of #triggerBlockReportForTests and continue to the unit test cases, then fall into similar error situation.

        IMHO like you mentioned, two times #triggerBlockReportForTests will make the tests more consistent. I'm attaching a patch showing the changes, please review the patch again. Thanks!

        Show
        rakeshr Rakesh R added a comment - Thanks Masatake Iwasaki for the interest and useful comments. I could see, again #triggerBlockReportForTests can immediately return before acknowledging the ActiveNN. Below is the sequence: 1=> During startUp(), it will call dn.getAllBpOs().get(0).triggerBlockReportForTests() and initializes final long oldBlockReportTime = scheduler.nextBlockReportTime; 2=> BPServiceActor#start(). 3=> Starting of the actor thread will call the function BPServiceActor#connectToNNAndHandshake() 4=> BPServiceActor#register() 5=> scheduler#scheduleBlockReport(dnConf.initialBlockReportDelayMs); Now, #scheduleBlockReport function call will update nextBlockReportTime = monotonicNow(); . This will again stops waiting period of #triggerBlockReportForTests and continue to the unit test cases, then fall into similar error situation. IMHO like you mentioned, two times #triggerBlockReportForTests will make the tests more consistent. I'm attaching a patch showing the changes, please review the patch again. Thanks!
        Hide
        walter.k.su Walter Su added a comment -

        Or we can do a waitFor with

        +    verify(namenode, timeout(10000).atLeastOnce()).sendHeartbeat(
        +        Mockito.any(DatanodeRegistration.class),
        +        Mockito.any(StorageReport[].class),
        +        Mockito.anyLong(),
        +        Mockito.anyLong(),
        +        Mockito.anyInt(),
        +        Mockito.anyInt(),
        +        Mockito.anyInt(),
        +        Mockito.any(VolumeFailureSummary.class),
        +        Mockito.anyBoolean());
        

        All we want is to get DN registered. triggerBlockReportForTests looks weird to me. I don't know. It's just personal preference. Your approaches works fine too.

        Show
        walter.k.su Walter Su added a comment - Or we can do a waitFor with + verify(namenode, timeout(10000).atLeastOnce()).sendHeartbeat( + Mockito.any(DatanodeRegistration.class), + Mockito.any(StorageReport[].class), + Mockito.anyLong(), + Mockito.anyLong(), + Mockito.anyInt(), + Mockito.anyInt(), + Mockito.anyInt(), + Mockito.any(VolumeFailureSummary.class), + Mockito.anyBoolean()); All we want is to get DN registered. triggerBlockReportForTests looks weird to me. I don't know. It's just personal preference. Your approaches works fine too.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 16s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 10m 32s trunk passed
        +1 compile 1m 14s trunk passed with JDK v1.8.0_66
        +1 compile 0m 58s trunk passed with JDK v1.7.0_79
        +1 checkstyle 0m 20s trunk passed
        +1 mvnsite 1m 11s trunk passed
        +1 mvneclipse 0m 18s trunk passed
        +1 findbugs 2m 31s trunk passed
        +1 javadoc 1m 38s trunk passed with JDK v1.8.0_66
        +1 javadoc 2m 45s trunk passed with JDK v1.7.0_79
        +1 mvninstall 1m 12s the patch passed
        +1 compile 1m 10s the patch passed with JDK v1.8.0_66
        +1 javac 1m 10s the patch passed
        +1 compile 0m 58s the patch passed with JDK v1.7.0_79
        +1 javac 0m 58s the patch passed
        +1 checkstyle 0m 20s the patch passed
        +1 mvnsite 1m 14s the patch passed
        +1 mvneclipse 0m 18s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 45s the patch passed
        +1 javadoc 1m 37s the patch passed with JDK v1.8.0_66
        +1 javadoc 2m 31s the patch passed with JDK v1.7.0_79
        -1 unit 87m 2s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 75m 2s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
        -1 asflicense 0m 32s Patch generated 56 ASF License warnings.
        200m 5s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
          hadoop.hdfs.server.namenode.TestStartup
          hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
          hadoop.hdfs.server.datanode.TestDirectoryScanner
        JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
          hadoop.hdfs.TestSafeMode
          hadoop.hdfs.TestFileCreationDelete
          hadoop.hdfs.server.datanode.TestDirectoryScanner



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2015-11-18
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772925/HDFS-9435-02.patch
        JIRA Issue HDFS-9435
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux c54a7abf0774 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh
        git revision trunk / 7fab5c8
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13545/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 76MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13545/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 10m 32s trunk passed +1 compile 1m 14s trunk passed with JDK v1.8.0_66 +1 compile 0m 58s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 20s trunk passed +1 mvnsite 1m 11s trunk passed +1 mvneclipse 0m 18s trunk passed +1 findbugs 2m 31s trunk passed +1 javadoc 1m 38s trunk passed with JDK v1.8.0_66 +1 javadoc 2m 45s trunk passed with JDK v1.7.0_79 +1 mvninstall 1m 12s the patch passed +1 compile 1m 10s the patch passed with JDK v1.8.0_66 +1 javac 1m 10s the patch passed +1 compile 0m 58s the patch passed with JDK v1.7.0_79 +1 javac 0m 58s the patch passed +1 checkstyle 0m 20s the patch passed +1 mvnsite 1m 14s the patch passed +1 mvneclipse 0m 18s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 45s the patch passed +1 javadoc 1m 37s the patch passed with JDK v1.8.0_66 +1 javadoc 2m 31s the patch passed with JDK v1.7.0_79 -1 unit 87m 2s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 75m 2s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 32s Patch generated 56 ASF License warnings. 200m 5s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   hadoop.hdfs.server.namenode.TestStartup   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   hadoop.hdfs.server.datanode.TestDirectoryScanner JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.TestSafeMode   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-18 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772925/HDFS-9435-02.patch JIRA Issue HDFS-9435 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux c54a7abf0774 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh git revision trunk / 7fab5c8 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13545/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13545/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 76MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13545/console This message was automatically generated.
        Hide
        rakeshr Rakesh R added a comment -

        Thanks a lot Walter Su for the comments. Yes, we should have a mechanism to wait for the active NN updation. I think waitFor would give enough time to perform the following operation and updates the activeNN. During the test startup, we have already dn.getAllBpOs().get(0).triggerHeartbeatForTests(); schedule heartbeat. Shall I post another patch with only waitFor, probably will wait for upto 15secs. Does this sounds good to you?

        BPServiceActor.java
        
        bpos.updateActorStatesFromHeartbeat(this, resp.getNameNodeHaState());
        
        Show
        rakeshr Rakesh R added a comment - Thanks a lot Walter Su for the comments. Yes, we should have a mechanism to wait for the active NN updation. I think waitFor would give enough time to perform the following operation and updates the activeNN. During the test startup, we have already dn.getAllBpOs().get(0).triggerHeartbeatForTests(); schedule heartbeat. Shall I post another patch with only waitFor , probably will wait for upto 15secs. Does this sounds good to you? BPServiceActor.java bpos.updateActorStatesFromHeartbeat( this , resp.getNameNodeHaState());
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 9m 30s trunk passed
        +1 compile 1m 31s trunk passed with JDK v1.8.0_66
        +1 compile 0m 48s trunk passed with JDK v1.7.0_79
        +1 checkstyle 0m 18s trunk passed
        +1 mvnsite 0m 58s trunk passed
        +1 mvneclipse 0m 16s trunk passed
        +1 findbugs 2m 12s trunk passed
        +1 javadoc 1m 21s trunk passed with JDK v1.8.0_66
        +1 javadoc 2m 10s trunk passed with JDK v1.7.0_79
        +1 mvninstall 0m 57s the patch passed
        +1 compile 0m 53s the patch passed with JDK v1.8.0_66
        +1 javac 0m 53s the patch passed
        +1 compile 0m 48s the patch passed with JDK v1.7.0_79
        +1 javac 0m 48s the patch passed
        +1 checkstyle 0m 17s the patch passed
        +1 mvnsite 0m 57s the patch passed
        +1 mvneclipse 0m 15s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 27s the patch passed
        +1 javadoc 1m 25s the patch passed with JDK v1.8.0_66
        +1 javadoc 2m 28s the patch passed with JDK v1.7.0_79
        -1 unit 93m 9s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 84m 39s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
        -1 asflicense 0m 23s Patch generated 56 ASF License warnings.
        211m 40s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.shortcircuit.TestShortCircuitCache
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          hadoop.hdfs.TestEncryptionZones
          hadoop.hdfs.server.datanode.TestDirectoryScanner
        JDK v1.7.0_79 Failed junit tests hadoop.hdfs.TestBlockStoragePolicy
          hadoop.hdfs.TestLeaseRecovery2
          hadoop.hdfs.server.namenode.TestParallelImageWrite
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090
          hadoop.hdfs.TestDFSStripedOutputStream
          hadoop.hdfs.TestPipelines
          hadoop.hdfs.TestEncryptionZones
          hadoop.hdfs.server.namenode.TestCacheDirectives
          hadoop.hdfs.server.datanode.TestDirectoryScanner



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2015-11-18
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12773001/HDFS-9435-03.patch
        JIRA Issue HDFS-9435
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 3efbf6141088 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh
        git revision trunk / 4a3b8f1
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13547/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 78MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13547/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 9m 30s trunk passed +1 compile 1m 31s trunk passed with JDK v1.8.0_66 +1 compile 0m 48s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 18s trunk passed +1 mvnsite 0m 58s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 2m 12s trunk passed +1 javadoc 1m 21s trunk passed with JDK v1.8.0_66 +1 javadoc 2m 10s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 57s the patch passed +1 compile 0m 53s the patch passed with JDK v1.8.0_66 +1 javac 0m 53s the patch passed +1 compile 0m 48s the patch passed with JDK v1.7.0_79 +1 javac 0m 48s the patch passed +1 checkstyle 0m 17s the patch passed +1 mvnsite 0m 57s the patch passed +1 mvneclipse 0m 15s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 27s the patch passed +1 javadoc 1m 25s the patch passed with JDK v1.8.0_66 +1 javadoc 2m 28s the patch passed with JDK v1.7.0_79 -1 unit 93m 9s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 84m 39s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 23s Patch generated 56 ASF License warnings. 211m 40s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.server.datanode.TestDirectoryScanner JDK v1.7.0_79 Failed junit tests hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.namenode.TestParallelImageWrite   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090   hadoop.hdfs.TestDFSStripedOutputStream   hadoop.hdfs.TestPipelines   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-18 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12773001/HDFS-9435-03.patch JIRA Issue HDFS-9435 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 3efbf6141088 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh git revision trunk / 4a3b8f1 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13547/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13547/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 78MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13547/console This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 7s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 8m 25s trunk passed
        +1 compile 0m 49s trunk passed with JDK v1.8.0_66
        +1 compile 0m 46s trunk passed with JDK v1.7.0_85
        +1 checkstyle 0m 17s trunk passed
        +1 mvnsite 0m 57s trunk passed
        +1 mvneclipse 0m 16s trunk passed
        +1 findbugs 1m 59s trunk passed
        +1 javadoc 1m 14s trunk passed with JDK v1.8.0_66
        +1 javadoc 1m 56s trunk passed with JDK v1.7.0_85
        +1 mvninstall 0m 52s the patch passed
        +1 compile 0m 47s the patch passed with JDK v1.8.0_66
        +1 javac 0m 47s the patch passed
        +1 compile 0m 46s the patch passed with JDK v1.7.0_85
        +1 javac 0m 46s the patch passed
        +1 checkstyle 0m 16s the patch passed
        +1 mvnsite 0m 56s the patch passed
        +1 mvneclipse 0m 15s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 9s the patch passed
        +1 javadoc 1m 12s the patch passed with JDK v1.8.0_66
        +1 javadoc 1m 54s the patch passed with JDK v1.7.0_85
        -1 unit 60m 49s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 57m 40s hadoop-hdfs in the patch failed with JDK v1.7.0_85.
        -1 asflicense 0m 25s Patch generated 58 ASF License warnings.
        147m 29s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.TestDFSClientRetries
        JDK v1.7.0_85 Failed junit tests hadoop.hdfs.server.namenode.TestBackupNode
          hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
          hadoop.hdfs.server.namenode.TestCacheDirectives
          hadoop.hdfs.TestDFSUpgradeFromImage



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2015-11-19
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12773001/HDFS-9435-03.patch
        JIRA Issue HDFS-9435
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 40ea55d95bd8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh
        git revision trunk / 23a130a
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt
        JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13560/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 77MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13560/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 7s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 8m 25s trunk passed +1 compile 0m 49s trunk passed with JDK v1.8.0_66 +1 compile 0m 46s trunk passed with JDK v1.7.0_85 +1 checkstyle 0m 17s trunk passed +1 mvnsite 0m 57s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 1m 59s trunk passed +1 javadoc 1m 14s trunk passed with JDK v1.8.0_66 +1 javadoc 1m 56s trunk passed with JDK v1.7.0_85 +1 mvninstall 0m 52s the patch passed +1 compile 0m 47s the patch passed with JDK v1.8.0_66 +1 javac 0m 47s the patch passed +1 compile 0m 46s the patch passed with JDK v1.7.0_85 +1 javac 0m 46s the patch passed +1 checkstyle 0m 16s the patch passed +1 mvnsite 0m 56s the patch passed +1 mvneclipse 0m 15s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 9s the patch passed +1 javadoc 1m 12s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 54s the patch passed with JDK v1.7.0_85 -1 unit 60m 49s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 57m 40s hadoop-hdfs in the patch failed with JDK v1.7.0_85. -1 asflicense 0m 25s Patch generated 58 ASF License warnings. 147m 29s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.TestDFSClientRetries JDK v1.7.0_85 Failed junit tests hadoop.hdfs.server.namenode.TestBackupNode   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.TestDFSUpgradeFromImage Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-19 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12773001/HDFS-9435-03.patch JIRA Issue HDFS-9435 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 40ea55d95bd8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh git revision trunk / 23a130a findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13560/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13560/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 77MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13560/console This message was automatically generated.
        Hide
        walter.k.su Walter Su added a comment -

        +1

        Show
        walter.k.su Walter Su added a comment - +1
        Hide
        walter.k.su Walter Su added a comment -

        I've committed the patch to trunk and branch-2. Thanks Rakesh R for the contribution. Also thanks Masatake Iwasaki for the good advises.

        Show
        walter.k.su Walter Su added a comment - I've committed the patch to trunk and branch-2. Thanks Rakesh R for the contribution. Also thanks Masatake Iwasaki for the good advises.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #8860 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8860/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8860 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8860/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        rakeshr Rakesh R added a comment -

        Thank you Walter Su for the final reviews and commits the patch.

        Show
        rakeshr Rakesh R added a comment - Thank you Walter Su for the final reviews and commits the patch.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #702 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/702/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #702 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/702/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #713 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/713/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #713 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/713/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #1436 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1436/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1436 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1436/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2643 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2643/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2643 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2643/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2569 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2569/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2569 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2569/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #631 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/631/)
        HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #631 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/631/ ) HDFS-9435 . TestBlockRecovery#testRBWReplicas is failing intermittently. (waltersu4549: rev 001ecf962cc93f4b880922b6eb03a5ca5d21f661) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java

          People

          • Assignee:
            rakeshr Rakesh R
            Reporter:
            rakeshr Rakesh R
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development