Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9426

Rollingupgrade finalization is not backward compatible

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.2, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      After HDFS-7645, the namenode can return non-null rollingUpgradeInfo in heatbeat reponses. 2.7.1 or 2.6.x datanodes won't finalize the upgrade because it's not null.

      NN might have to check the DN version and return different rollingUpgradeInfo.

      HDFS-8656 recognized the compatibility issue of the changed semantics, but unfortunately did not address the semantics of the heartbeat response.

      1. HDFS-9426.branch-2.7.poc.patch
        4 kB
        Kihwal Lee
      2. HDFS-9426.trunk.poc.patch
        4 kB
        Kihwal Lee

        Issue Links

          Activity

          Hide
          kihwal Kihwal Lee added a comment -

          NN might have to check the DN version and return different rollingUpgradeInfo.

          In order to maintain the protocol semantics, it might be better to set the RU state to null and return another one in a new optional field for newer datanode to use.

          Show
          kihwal Kihwal Lee added a comment - NN might have to check the DN version and return different rollingUpgradeInfo. In order to maintain the protocol semantics, it might be better to set the RU state to null and return another one in a new optional field for newer datanode to use.
          Hide
          vinayrpet Vinayakumar B added a comment -

          After HDFS-7645, the namenode can return non-null rollingUpgradeInfo in heatbeat reponses. 2.7.1 or 2.6.x datanodes won't finalize the upgrade because it's not null.

          I agree that 2.7.1 or 2.6.x datanodes wont understand finalize message.

          But is that expected scenario, where cluster upgrade can be finalized without complete upgrade of all datanodes?

          Show
          vinayrpet Vinayakumar B added a comment - After HDFS-7645 , the namenode can return non-null rollingUpgradeInfo in heatbeat reponses. 2.7.1 or 2.6.x datanodes won't finalize the upgrade because it's not null. I agree that 2.7.1 or 2.6.x datanodes wont understand finalize message. But is that expected scenario, where cluster upgrade can be finalized without complete upgrade of all datanodes?
          Hide
          kihwal Kihwal Lee added a comment -

          But is that expected scenario, where cluster upgrade can be finalized without complete upgrade of all datanodes?

          Yes. For larger clusters a rolling upgrade might take a while. If they don't have enough free space or there is huge churn of blocks, the remaining space will shrink quickly. In that case users have to finalize the upgrade after enough number of nodes roll and no anomaly is observed.

          Show
          kihwal Kihwal Lee added a comment - But is that expected scenario, where cluster upgrade can be finalized without complete upgrade of all datanodes? Yes. For larger clusters a rolling upgrade might take a while. If they don't have enough free space or there is huge churn of blocks, the remaining space will shrink quickly. In that case users have to finalize the upgrade after enough number of nodes roll and no anomaly is observed.
          Hide
          vinayrpet Vinayakumar B added a comment -

          Yes. For larger clusters a rolling upgrade might take a while. If they don't have enough free space or there is huge churn of blocks, the remaining space will shrink quickly. In that case users have to finalize the upgrade after enough number of nodes roll and no anomaly is observed.

          In that case, what should/will be behavior of datanodes, when remaining datanodes attempted for upgrade.

          Show
          vinayrpet Vinayakumar B added a comment - Yes. For larger clusters a rolling upgrade might take a while. If they don't have enough free space or there is huge churn of blocks, the remaining space will shrink quickly. In that case users have to finalize the upgrade after enough number of nodes roll and no anomaly is observed. In that case, what should/will be behavior of datanodes, when remaining datanodes attempted for upgrade.
          Hide
          kihwal Kihwal Lee added a comment -

          The remaining datanodes should stop populating trash. Conceptually we could make it clear trash on upgrade or right away. But the older version of datanodes can only do the latter.

          Show
          kihwal Kihwal Lee added a comment - The remaining datanodes should stop populating trash. Conceptually we could make it clear trash on upgrade or right away. But the older version of datanodes can only do the latter.
          Hide
          kihwal Kihwal Lee added a comment -

          Attaching a proof-of-concept patch for design discussion.

          Show
          kihwal Kihwal Lee added a comment - Attaching a proof-of-concept patch for design discussion.
          Hide
          kihwal Kihwal Lee added a comment -

          I've also noticed that when 2.7.2rc0 namenode does RU finalization first and a pre 2.7.2 datanode later upgrades, it deletes the ru marker file but does not clear the trash. As far as I can see it stops populating the trash. I haven't root-caused it yet.

          Show
          kihwal Kihwal Lee added a comment - I've also noticed that when 2.7.2rc0 namenode does RU finalization first and a pre 2.7.2 datanode later upgrades, it deletes the ru marker file but does not clear the trash. As far as I can see it stops populating the trash. I haven't root-caused it yet.
          Hide
          vinayrpet Vinayakumar B added a comment -

          The remaining datanodes should stop populating trash. Conceptually we could make it clear trash on upgrade or right away. But the older version of datanodes can only do the latter.

          Yes, thats correct. But it should be made clear that, If some problem in upgrading those remained nodes, then data will not be recovered, since upgrade will be immediately finalized in first heartbeat itself.

          IMO, proof of concept patch looks good.

          Show
          vinayrpet Vinayakumar B added a comment - The remaining datanodes should stop populating trash. Conceptually we could make it clear trash on upgrade or right away. But the older version of datanodes can only do the latter. Yes, thats correct. But it should be made clear that, If some problem in upgrading those remained nodes, then data will not be recovered, since upgrade will be immediately finalized in first heartbeat itself. IMO, proof of concept patch looks good.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          I don't want to stop progress on this, but I see that HDFS-7645 was later marked as incompatible change, so don't see why it should go into 2.7.2 at all.

          I'm starting a discussion on HDFS-7645 to see if it should be reverted from branch-2, please watch it there. Thanks.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - I don't want to stop progress on this, but I see that HDFS-7645 was later marked as incompatible change, so don't see why it should go into 2.7.2 at all. I'm starting a discussion on HDFS-7645 to see if it should be reverted from branch-2, please watch it there. Thanks.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Realized there was a follow-up HDFS-8656 to the incompatible change HDFS-7645, so now not entirely clear which way we should go. IAC, left a comment: https://issues.apache.org/jira/browse/HDFS-7645?focusedCommentId=15004464&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15004464.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Realized there was a follow-up HDFS-8656 to the incompatible change HDFS-7645 , so now not entirely clear which way we should go. IAC, left a comment: https://issues.apache.org/jira/browse/HDFS-7645?focusedCommentId=15004464&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15004464 .
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Kihwal Lee / Vinayakumar B, any update on this?

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Kihwal Lee / Vinayakumar B , any update on this?
          Hide
          kihwal Kihwal Lee added a comment -

          I tested it with 2.7.2 namenode and 2.6 datanodes. The 2.6 datanodes deleted the marker files and trash directories. So we know the proposed patch is correct.
          I am just wondering whether it will be worth doing more code changes to avoid introducing the redundant field in the new protocol. Vinayakumar B, what do you think?

          Show
          kihwal Kihwal Lee added a comment - I tested it with 2.7.2 namenode and 2.6 datanodes. The 2.6 datanodes deleted the marker files and trash directories. So we know the proposed patch is correct. I am just wondering whether it will be worth doing more code changes to avoid introducing the redundant field in the new protocol. Vinayakumar B , what do you think?
          Hide
          vinayrpet Vinayakumar B added a comment - - edited

          I am just wondering whether it will be worth doing more code changes to avoid introducing the redundant field in the new protocol. Vinayakumar B, what do you think?

          I am thinking current patch is sufficient for the fix. At-least to resolve this blocker for 2.7.2.

          Is there any other way, except this fix and reverting HDFS-7645?

          Show
          vinayrpet Vinayakumar B added a comment - - edited I am just wondering whether it will be worth doing more code changes to avoid introducing the redundant field in the new protocol. Vinayakumar B, what do you think? I am thinking current patch is sufficient for the fix. At-least to resolve this blocker for 2.7.2. Is there any other way, except this fix and reverting HDFS-7645 ?
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 10s docker + precommit patch detected.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 8m 31s trunk passed
          +1 compile 0m 55s trunk passed with JDK v1.8.0_66
          +1 compile 0m 49s trunk passed with JDK v1.7.0_79
          +1 checkstyle 0m 18s trunk passed
          +1 mvnsite 0m 59s trunk passed
          +1 mvneclipse 0m 16s trunk passed
          +1 findbugs 2m 11s trunk passed
          +1 javadoc 1m 23s trunk passed with JDK v1.8.0_66
          +1 javadoc 2m 9s trunk passed with JDK v1.7.0_79
          +1 mvninstall 0m 57s the patch passed
          +1 compile 0m 54s the patch passed with JDK v1.8.0_66
          +1 cc 0m 54s the patch passed
          -1 javac 7m 34s hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66 with JDK v1.8.0_66 generated 3 new issues (was 33, now 33).
          +1 javac 0m 54s the patch passed
          +1 compile 0m 47s the patch passed with JDK v1.7.0_79
          +1 cc 0m 47s the patch passed
          -1 javac 8m 22s hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79 with JDK v1.7.0_79 generated 3 new issues (was 35, now 35).
          +1 javac 0m 47s the patch passed
          -1 checkstyle 0m 18s Patch generated 1 new checkstyle issues in hadoop-hdfs-project/hadoop-hdfs (total was 15, now 16).
          +1 mvnsite 0m 59s the patch passed
          +1 mvneclipse 0m 16s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 27s the patch passed
          +1 javadoc 1m 26s the patch passed with JDK v1.8.0_66
          +1 javadoc 2m 12s the patch passed with JDK v1.7.0_79
          -1 unit 83m 29s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
          -1 unit 87m 26s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
          -1 asflicense 0m 25s Patch generated 56 ASF License warnings.
          202m 27s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.hdfs.TestWriteReadStripedFile
            hadoop.hdfs.server.datanode.TestBlockReplacement
            hadoop.hdfs.server.datanode.TestDirectoryScanner
          JDK v1.7.0_79 Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
            hadoop.hdfs.server.datanode.TestBlockScanner
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
            hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
            hadoop.hdfs.server.datanode.TestDirectoryScanner



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:date2015-11-20
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772248/HDFS-9426.trunk.poc.patch
          JIRA Issue HDFS-9426
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
          uname Linux b64cfe90a7ef 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh
          git revision trunk / 4539131
          findbugs v3.0.0
          javac hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
          javac hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79: https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
          JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13578/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Max memory used 78MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13578/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 8m 31s trunk passed +1 compile 0m 55s trunk passed with JDK v1.8.0_66 +1 compile 0m 49s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 18s trunk passed +1 mvnsite 0m 59s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 2m 11s trunk passed +1 javadoc 1m 23s trunk passed with JDK v1.8.0_66 +1 javadoc 2m 9s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 57s the patch passed +1 compile 0m 54s the patch passed with JDK v1.8.0_66 +1 cc 0m 54s the patch passed -1 javac 7m 34s hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66 with JDK v1.8.0_66 generated 3 new issues (was 33, now 33). +1 javac 0m 54s the patch passed +1 compile 0m 47s the patch passed with JDK v1.7.0_79 +1 cc 0m 47s the patch passed -1 javac 8m 22s hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79 with JDK v1.7.0_79 generated 3 new issues (was 35, now 35). +1 javac 0m 47s the patch passed -1 checkstyle 0m 18s Patch generated 1 new checkstyle issues in hadoop-hdfs-project/hadoop-hdfs (total was 15, now 16). +1 mvnsite 0m 59s the patch passed +1 mvneclipse 0m 16s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 27s the patch passed +1 javadoc 1m 26s the patch passed with JDK v1.8.0_66 +1 javadoc 2m 12s the patch passed with JDK v1.7.0_79 -1 unit 83m 29s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 87m 26s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 25s Patch generated 56 ASF License warnings. 202m 27s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.TestWriteReadStripedFile   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.server.datanode.TestDirectoryScanner JDK v1.7.0_79 Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-20 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12772248/HDFS-9426.trunk.poc.patch JIRA Issue HDFS-9426 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux b64cfe90a7ef 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh git revision trunk / 4539131 findbugs v3.0.0 javac hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt javac hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79: https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13578/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13578/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 78MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13578/console This message was automatically generated.
          Hide
          kihwal Kihwal Lee added a comment -

          The failed test cases pass when run on my machine. One test case TestEditLogTailer#testNN1TriggersLogRolls failed once during multiple runs, but the failure was not related to this patch.

          Show
          kihwal Kihwal Lee added a comment - The failed test cases pass when run on my machine. One test case TestEditLogTailer#testNN1TriggersLogRolls failed once during multiple runs, but the failure was not related to this patch.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Vinayakumar B, can you look at Kihwal Lee's patch and get it reviewed / committed? I am holding off 2.7.2 for this one, please let me know if this needs more time. Thanks.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Vinayakumar B , can you look at Kihwal Lee 's patch and get it reviewed / committed? I am holding off 2.7.2 for this one, please let me know if this needs more time. Thanks.
          Hide
          vinayrpet Vinayakumar B added a comment -

          +1 for the patch,

          Committing

          Show
          vinayrpet Vinayakumar B added a comment - +1 for the patch, Committing
          Hide
          vinayrpet Vinayakumar B added a comment -

          Committed to trunk, branch-2, branch-2.7 and branch-2.7.2

          Show
          vinayrpet Vinayakumar B added a comment - Committed to trunk, branch-2, branch-2.7 and branch-2.7.2
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8895 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8895/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8895 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8895/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #727 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/727/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #727 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/727/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1458 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1458/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1458 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1458/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #738 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/738/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #738 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/738/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2669 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2669/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2669 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2669/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #646 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/646/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #646 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/646/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2583 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2583/)
          HDFS-9426. Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2583 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2583/ ) HDFS-9426 . Rollingupgrade finalization is not backward compatible (vinayakumarb: rev 9f256d1d716a7e17606245fcfc619901a8fa299a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          kihwal Kihwal Lee added a comment -

          Vinayakumar B Looks like it just missed branch-2.8.

          Show
          kihwal Kihwal Lee added a comment - Vinayakumar B Looks like it just missed branch-2.8.
          Hide
          kihwal Kihwal Lee added a comment -

          cherry-picked to 2.8.

          Show
          kihwal Kihwal Lee added a comment - cherry-picked to 2.8.

            People

            • Assignee:
              kihwal Kihwal Lee
              Reporter:
              kihwal Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development