Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9688

Test the effect of nested encryption zones in HDFS downgrade

    Details

    • Type: Test
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.3, 2.6.5
    • Component/s: encryption, test
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    1. HDFS-9688-branch-2.6.00.patch
      7 kB
      Zhe Zhang
    2. HDFS-9688-branch-2.6.01.patch
      10 kB
      Zhe Zhang
    3. HDFS-9688-branch-2.7.03.patch
      11 kB
      Zhe Zhang
    4. HDFS-9688-branch-2.7.04.patch
      11 kB
      Zhe Zhang
    5. HDFS-9688-branch-2.8.03.patch
      11 kB
      Zhe Zhang

      Issue Links

        Activity

        Hide
        zhz Zhe Zhang added a comment -

        Initial patch to demonstrate the idea. Actually I don't think restarting NN is necessary, because the restarting process merely loads XAttrs without trying to interpret them as EZs.

        Show
        zhz Zhe Zhang added a comment - Initial patch to demonstrate the idea. Actually I don't think restarting NN is necessary, because the restarting process merely loads XAttrs without trying to interpret them as EZs.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 8m 0s branch-2.6 passed
        -1 compile 0m 48s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_66.
        -1 compile 0m 48s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91.
        +1 checkstyle 0m 23s branch-2.6 passed
        +1 mvnsite 1m 1s branch-2.6 passed
        +1 mvneclipse 0m 19s branch-2.6 passed
        -1 findbugs 3m 12s hadoop-hdfs-project/hadoop-hdfs in branch-2.6 has 273 extant Findbugs warnings.
        +1 javadoc 1m 19s branch-2.6 passed with JDK v1.8.0_66
        +1 javadoc 1m 59s branch-2.6 passed with JDK v1.7.0_91
        +1 mvninstall 0m 58s the patch passed
        -1 compile 0m 46s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 javac 0m 46s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 compile 0m 47s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 javac 0m 47s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        +1 checkstyle 0m 19s the patch passed
        +1 mvnsite 0m 57s the patch passed
        +1 mvneclipse 0m 13s the patch passed
        -1 whitespace 0m 2s The patch has 1212 line(s) that end in whitespace. Use git apply --whitespace=fix.
        -1 whitespace 0m 31s The patch has 95 line(s) with tabs.
        +1 findbugs 3m 22s the patch passed
        +1 javadoc 1m 15s the patch passed with JDK v1.8.0_66
        +1 javadoc 1m 58s the patch passed with JDK v1.7.0_91
        -1 unit 0m 46s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 0m 47s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 asflicense 0m 37s Patch generated 74 ASF License warnings.
        34m 2s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2016-01-23
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783968/HDFS-9688-branch-2.6.00.patch
        JIRA Issue HDFS-9688
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 1eccb4da09a8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.6 / 4c8a659
        Default Java 1.7.0_91
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        findbugs v1.3.9
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/whitespace-eol.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/whitespace-tabs.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14217/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 70MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14217/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 8m 0s branch-2.6 passed -1 compile 0m 48s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_66. -1 compile 0m 48s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91. +1 checkstyle 0m 23s branch-2.6 passed +1 mvnsite 1m 1s branch-2.6 passed +1 mvneclipse 0m 19s branch-2.6 passed -1 findbugs 3m 12s hadoop-hdfs-project/hadoop-hdfs in branch-2.6 has 273 extant Findbugs warnings. +1 javadoc 1m 19s branch-2.6 passed with JDK v1.8.0_66 +1 javadoc 1m 59s branch-2.6 passed with JDK v1.7.0_91 +1 mvninstall 0m 58s the patch passed -1 compile 0m 46s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 javac 0m 46s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 compile 0m 47s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 javac 0m 47s hadoop-hdfs in the patch failed with JDK v1.7.0_91. +1 checkstyle 0m 19s the patch passed +1 mvnsite 0m 57s the patch passed +1 mvneclipse 0m 13s the patch passed -1 whitespace 0m 2s The patch has 1212 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 0m 31s The patch has 95 line(s) with tabs. +1 findbugs 3m 22s the patch passed +1 javadoc 1m 15s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 58s the patch passed with JDK v1.7.0_91 -1 unit 0m 46s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 0m 47s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 asflicense 0m 37s Patch generated 74 ASF License warnings. 34m 2s Subsystem Report/Notes Docker Image:yetus/hadoop:date2016-01-23 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783968/HDFS-9688-branch-2.6.00.patch JIRA Issue HDFS-9688 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 1eccb4da09a8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.6 / 4c8a659 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt findbugs v1.3.9 findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14217/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14217/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 70MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14217/console This message was automatically generated.
        Hide
        andrew.wang Andrew Wang added a comment -

        Hi Zhe, thanks for working on this. Overall looks good, some comments mostly about testing:

        • This new method is a copy paste of the existing createEncryptionZone function, possible to code share?
        • Make sure nested EZs can be loaded from FSImage as well as edit log
        • Rename of EZ roots. Fortunately we use inode IDs in the EZ map so don't need to do path rewriting, but I'd still like to see tests of expected behavior.
        • Rename of files into and out of nested EZs, make sure the existing restrictions are still in place.

        I assume also we want to do HDFS-9244 before this branch-2 improvement? Or is this patch intended just for example purposes?

        Show
        andrew.wang Andrew Wang added a comment - Hi Zhe, thanks for working on this. Overall looks good, some comments mostly about testing: This new method is a copy paste of the existing createEncryptionZone function, possible to code share? Make sure nested EZs can be loaded from FSImage as well as edit log Rename of EZ roots. Fortunately we use inode IDs in the EZ map so don't need to do path rewriting, but I'd still like to see tests of expected behavior. Rename of files into and out of nested EZs, make sure the existing restrictions are still in place. I assume also we want to do HDFS-9244 before this branch-2 improvement? Or is this patch intended just for example purposes?
        Hide
        zhz Zhe Zhang added a comment -

        Thanks Andrew for the review!

        I initially preferred not modifying any existing code (hence added a new method with much dup code). But it's actually hard that way, because create EZ goes through multiple levels, including namesystem, directory. Version 0 patch didn't persist the XAttr to edit logs.

        So the new patch added a test-only flag instead.

        Please let me know if you see any additional tests we should add.

        Show
        zhz Zhe Zhang added a comment - Thanks Andrew for the review! I initially preferred not modifying any existing code (hence added a new method with much dup code). But it's actually hard that way, because create EZ goes through multiple levels, including namesystem, directory. Version 0 patch didn't persist the XAttr to edit logs. So the new patch added a test-only flag instead. Please let me know if you see any additional tests we should add.
        Hide
        zhz Zhe Zhang added a comment -

        And I don't think we necessarily need HDFS-9244 before this change. They will never exist in the same branch anyway.

        Show
        zhz Zhe Zhang added a comment - And I don't think we necessarily need HDFS-9244 before this change. They will never exist in the same branch anyway.
        Hide
        andrew.wang Andrew Wang added a comment -

        Code LGTM, +1 pending Jenkins.

        Show
        andrew.wang Andrew Wang added a comment - Code LGTM, +1 pending Jenkins.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        -1 mvninstall 1m 53s root in branch-2.6 failed.
        -1 compile 0m 9s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72.
        -1 compile 0m 6s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91.
        +1 checkstyle 0m 9s branch-2.6 passed
        -1 mvnsite 0m 7s hadoop-hdfs in branch-2.6 failed.
        -1 mvneclipse 0m 13s hadoop-hdfs in branch-2.6 failed.
        -1 findbugs 0m 7s hadoop-hdfs in branch-2.6 failed.
        -1 javadoc 0m 5s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72.
        -1 javadoc 0m 6s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91.
        -1 mvninstall 0m 6s hadoop-hdfs in the patch failed.
        -1 compile 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javac 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 compile 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 javac 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        +1 checkstyle 0m 6s the patch passed
        -1 mvnsite 0m 7s hadoop-hdfs in the patch failed.
        -1 mvneclipse 0m 7s hadoop-hdfs in the patch failed.
        -1 whitespace 0m 1s The patch has 809 line(s) that end in whitespace. Use git apply --whitespace=fix.
        -1 whitespace 0m 19s The patch has 49 line(s) with tabs.
        -1 findbugs 0m 7s hadoop-hdfs in the patch failed.
        -1 javadoc 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javadoc 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 unit 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 unit 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 asflicense 0m 29s Patch generated 58 ASF License warnings.
        21m 30s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2016-01-28
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785047/HDFS-9688-branch-2.6.01.patch
        JIRA Issue HDFS-9688
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 87bd0c2d250c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.6 / ac43c56
        Default Java 1.7.0_91
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-mvninstall-root.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/whitespace-eol.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/whitespace-tabs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14283/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 40MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14283/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvninstall 1m 53s root in branch-2.6 failed. -1 compile 0m 9s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72. -1 compile 0m 6s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91. +1 checkstyle 0m 9s branch-2.6 passed -1 mvnsite 0m 7s hadoop-hdfs in branch-2.6 failed. -1 mvneclipse 0m 13s hadoop-hdfs in branch-2.6 failed. -1 findbugs 0m 7s hadoop-hdfs in branch-2.6 failed. -1 javadoc 0m 5s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72. -1 javadoc 0m 6s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91. -1 mvninstall 0m 6s hadoop-hdfs in the patch failed. -1 compile 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javac 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 compile 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 javac 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91. +1 checkstyle 0m 6s the patch passed -1 mvnsite 0m 7s hadoop-hdfs in the patch failed. -1 mvneclipse 0m 7s hadoop-hdfs in the patch failed. -1 whitespace 0m 1s The patch has 809 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 0m 19s The patch has 49 line(s) with tabs. -1 findbugs 0m 7s hadoop-hdfs in the patch failed. -1 javadoc 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javadoc 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 unit 0m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 unit 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 asflicense 0m 29s Patch generated 58 ASF License warnings. 21m 30s Subsystem Report/Notes Docker Image:yetus/hadoop:date2016-01-28 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785047/HDFS-9688-branch-2.6.01.patch JIRA Issue HDFS-9688 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 87bd0c2d250c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.6 / ac43c56 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-mvninstall-root.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14283/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14283/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 40MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14283/console This message was automatically generated.
        Hide
        zhz Zhe Zhang added a comment -

        Allen Wittenauer Does the above compile failure look alarming (any infra issue etc.)? Or it's just flaky and we should simply rerun it?

        Show
        zhz Zhe Zhang added a comment - Allen Wittenauer Does the above compile failure look alarming (any infra issue etc.)? Or it's just flaky and we should simply rerun it?
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        -1 mvninstall 0m 38s root in branch-2.6 failed.
        -1 compile 0m 9s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72.
        -1 compile 0m 8s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91.
        +1 checkstyle 0m 7s branch-2.6 passed
        -1 mvnsite 0m 7s hadoop-hdfs in branch-2.6 failed.
        -1 mvneclipse 0m 9s hadoop-hdfs in branch-2.6 failed.
        -1 findbugs 0m 8s hadoop-hdfs in branch-2.6 failed.
        -1 javadoc 0m 8s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72.
        -1 javadoc 0m 7s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91.
        -1 mvninstall 0m 7s hadoop-hdfs in the patch failed.
        -1 compile 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javac 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 compile 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 javac 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        +1 checkstyle 0m 7s the patch passed
        -1 mvnsite 0m 7s hadoop-hdfs in the patch failed.
        -1 mvneclipse 0m 9s hadoop-hdfs in the patch failed.
        -1 whitespace 0m 0s The patch has 1181 line(s) that end in whitespace. Use git apply --whitespace=fix.
        -1 whitespace 0m 25s The patch has 49 line(s) with tabs.
        -1 findbugs 0m 7s hadoop-hdfs in the patch failed.
        -1 javadoc 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javadoc 0m 8s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 unit 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 unit 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        -1 asflicense 0m 28s Patch generated 58 ASF License warnings.
        21m 56s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2016-01-29
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785047/HDFS-9688-branch-2.6.01.patch
        JIRA Issue HDFS-9688
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 959bb103b051 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.6 / ac43c56
        Default Java 1.7.0_91
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-mvninstall-root.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/whitespace-eol.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/whitespace-tabs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14284/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 40MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14284/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvninstall 0m 38s root in branch-2.6 failed. -1 compile 0m 9s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72. -1 compile 0m 8s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91. +1 checkstyle 0m 7s branch-2.6 passed -1 mvnsite 0m 7s hadoop-hdfs in branch-2.6 failed. -1 mvneclipse 0m 9s hadoop-hdfs in branch-2.6 failed. -1 findbugs 0m 8s hadoop-hdfs in branch-2.6 failed. -1 javadoc 0m 8s hadoop-hdfs in branch-2.6 failed with JDK v1.8.0_72. -1 javadoc 0m 7s hadoop-hdfs in branch-2.6 failed with JDK v1.7.0_91. -1 mvninstall 0m 7s hadoop-hdfs in the patch failed. -1 compile 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javac 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 compile 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 javac 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_91. +1 checkstyle 0m 7s the patch passed -1 mvnsite 0m 7s hadoop-hdfs in the patch failed. -1 mvneclipse 0m 9s hadoop-hdfs in the patch failed. -1 whitespace 0m 0s The patch has 1181 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 0m 25s The patch has 49 line(s) with tabs. -1 findbugs 0m 7s hadoop-hdfs in the patch failed. -1 javadoc 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javadoc 0m 8s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 unit 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 unit 0m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_91. -1 asflicense 0m 28s Patch generated 58 ASF License warnings. 21m 56s Subsystem Report/Notes Docker Image:yetus/hadoop:date2016-01-29 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785047/HDFS-9688-branch-2.6.01.patch JIRA Issue HDFS-9688 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 959bb103b051 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.6 / ac43c56 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-mvninstall-root.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14284/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14284/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 40MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14284/console This message was automatically generated.
        Hide
        aw Allen Wittenauer added a comment - - edited

        From the console link provided above:

        ERROR: Dockerfile '/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/dev-support/docker/Dockerfile' not found, falling back to built-in.
        

        The built-in Dockerfile that Yetus provides is no longer capable of building Hadoop. branch-2.6 is getting long in the tooth so doesn't have the Dockefile that the other 6 branches in active development apparently have. (that dev-support path up there is a checked out copy of the Hadoop repo). Solutions include retargetting to a different branch or someone working on the Hadoop project will need to commit a Dockerfile in that location for Yetus to use on Jenkins.

        Show
        aw Allen Wittenauer added a comment - - edited From the console link provided above: ERROR: Dockerfile '/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/dev-support/docker/Dockerfile' not found, falling back to built-in. The built-in Dockerfile that Yetus provides is no longer capable of building Hadoop. branch-2.6 is getting long in the tooth so doesn't have the Dockefile that the other 6 branches in active development apparently have. (that dev-support path up there is a checked out copy of the Hadoop repo). Solutions include retargetting to a different branch or someone working on the Hadoop project will need to commit a Dockerfile in that location for Yetus to use on Jenkins.
        Hide
        zhz Zhe Zhang added a comment -

        Thanks for the update Allen Wittenauer. I discussed with Andrew offline, this patch should actually be targeted for 2.8, and future maint releases of 2.6 and 2.7. Attaching a branch-2.8 patch.

        Andrew Wang Could you take another look? A tricky issue is "rename of root dir of EZ". I just found it's not allowed in 2.6, but allowed in 2.7 and forward. So we need to update the patch when backporting to 2.6. Also, renaming the root dir of a nested EZ won't be allowed, because the destination will be in an EZ (the parent EZ). I think this is the right behavior for nested EZ, but please see if you agree.

        Show
        zhz Zhe Zhang added a comment - Thanks for the update Allen Wittenauer . I discussed with Andrew offline, this patch should actually be targeted for 2.8, and future maint releases of 2.6 and 2.7. Attaching a branch-2.8 patch. Andrew Wang Could you take another look? A tricky issue is "rename of root dir of EZ". I just found it's not allowed in 2.6, but allowed in 2.7 and forward. So we need to update the patch when backporting to 2.6. Also, renaming the root dir of a nested EZ won't be allowed, because the destination will be in an EZ (the parent EZ). I think this is the right behavior for nested EZ, but please see if you agree.
        Hide
        xyao Xiaoyu Yao added a comment -

        Also, renaming the root dir of a nested EZ won't be allowed, because the destination will be in an EZ (the parent EZ). I think this is the right behavior for nested EZ, but please see if you agree.

        Zhe Zhang, Do you plan to block rename EZ root on 2.7 and forward? I don't think we should block rename EZ root, which is an incompatible change from 2.7 that can break Trash support for HDFS encryption. If I understand the nested EZ correctly, the renamed nested EZ will still be encrypted with its own zone key no matter the destination is encrypted with different keys or not.

        Show
        xyao Xiaoyu Yao added a comment - Also, renaming the root dir of a nested EZ won't be allowed, because the destination will be in an EZ (the parent EZ). I think this is the right behavior for nested EZ, but please see if you agree. Zhe Zhang , Do you plan to block rename EZ root on 2.7 and forward? I don't think we should block rename EZ root, which is an incompatible change from 2.7 that can break Trash support for HDFS encryption. If I understand the nested EZ correctly, the renamed nested EZ will still be encrypted with its own zone key no matter the destination is encrypted with different keys or not.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 8m 38s branch-2.8 passed
        +1 compile 0m 39s branch-2.8 passed with JDK v1.8.0_66
        +1 compile 0m 45s branch-2.8 passed with JDK v1.7.0_91
        +1 checkstyle 0m 21s branch-2.8 passed
        +1 mvnsite 0m 53s branch-2.8 passed
        +1 mvneclipse 0m 15s branch-2.8 passed
        +1 findbugs 1m 58s branch-2.8 passed
        +1 javadoc 1m 6s branch-2.8 passed with JDK v1.8.0_66
        +1 javadoc 1m 49s branch-2.8 passed with JDK v1.7.0_91
        +1 mvninstall 0m 44s the patch passed
        +1 compile 0m 36s the patch passed with JDK v1.8.0_66
        +1 javac 0m 36s the patch passed
        +1 compile 0m 37s the patch passed with JDK v1.7.0_91
        +1 javac 0m 37s the patch passed
        +1 checkstyle 0m 17s the patch passed
        +1 mvnsite 0m 47s the patch passed
        +1 mvneclipse 0m 10s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 3s the patch passed
        +1 javadoc 1m 5s the patch passed with JDK v1.8.0_66
        +1 javadoc 1m 43s the patch passed with JDK v1.7.0_91
        -1 unit 55m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
        -1 unit 47m 42s hadoop-hdfs in the patch failed with JDK v1.7.0_91.
        +1 asflicense 0m 21s Patch does not generate ASF License warnings.
        130m 12s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
        JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.hdfs.TestLeaseRecovery2
        JDK v1.7.0_91 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitCache
          hadoop.hdfs.server.namenode.TestNNThroughputBenchmark



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:c60792e
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785195/HDFS-9688-branch-2.8.02.patch
        JIRA Issue HDFS-9688
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux eebf5513f3d3 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.8 / eb2366e
        Default Java 1.7.0_91
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt
        JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14290/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 74MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14290/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 8m 38s branch-2.8 passed +1 compile 0m 39s branch-2.8 passed with JDK v1.8.0_66 +1 compile 0m 45s branch-2.8 passed with JDK v1.7.0_91 +1 checkstyle 0m 21s branch-2.8 passed +1 mvnsite 0m 53s branch-2.8 passed +1 mvneclipse 0m 15s branch-2.8 passed +1 findbugs 1m 58s branch-2.8 passed +1 javadoc 1m 6s branch-2.8 passed with JDK v1.8.0_66 +1 javadoc 1m 49s branch-2.8 passed with JDK v1.7.0_91 +1 mvninstall 0m 44s the patch passed +1 compile 0m 36s the patch passed with JDK v1.8.0_66 +1 javac 0m 36s the patch passed +1 compile 0m 37s the patch passed with JDK v1.7.0_91 +1 javac 0m 37s the patch passed +1 checkstyle 0m 17s the patch passed +1 mvnsite 0m 47s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 3s the patch passed +1 javadoc 1m 5s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 43s the patch passed with JDK v1.7.0_91 -1 unit 55m 5s hadoop-hdfs in the patch failed with JDK v1.8.0_66. -1 unit 47m 42s hadoop-hdfs in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 21s Patch does not generate ASF License warnings. 130m 12s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.TestNNThroughputBenchmark JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.hdfs.TestLeaseRecovery2 JDK v1.7.0_91 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.server.namenode.TestNNThroughputBenchmark Subsystem Report/Notes Docker Image:yetus/hadoop:c60792e JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785195/HDFS-9688-branch-2.8.02.patch JIRA Issue HDFS-9688 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux eebf5513f3d3 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.8 / eb2366e Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14290/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14290/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 74MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14290/console This message was automatically generated.
        Hide
        zhz Zhe Zhang added a comment -

        Thanks for the comment Xiaoyu Yao. I added a test in HDFS-9244 patch to verify Trash support. Let's reach a conclusion there and revisit this test JIRA.

        It's a hard semantic question, whether to support rename of the root dir of a nested EZ. Renaming it to a non-EZ path should certainly be supported. But whether to support renaming it into an EZ is not so obvious. Andrew Wang Any opinion here?

        Show
        zhz Zhe Zhang added a comment - Thanks for the comment Xiaoyu Yao . I added a test in HDFS-9244 patch to verify Trash support. Let's reach a conclusion there and revisit this test JIRA. It's a hard semantic question, whether to support rename of the root dir of a nested EZ. Renaming it to a non-EZ path should certainly be supported. But whether to support renaming it into an EZ is not so obvious. Andrew Wang Any opinion here?
        Hide
        andrew.wang Andrew Wang added a comment -

        IIUC for trash support, we need to be able to rename a nested EZ to the trash folder within its parent. Renaming a nested EZ within the same parent EZ seems okay to me, since we already allow renaming things within an EZ.

        If anything, renaming it outside of the parent EZ is more questionable, since it's currently not possible to rename anything out of an EZ. Since the contents will still be correctly interpreted I think it's okay, but did want to mention it.

        Show
        andrew.wang Andrew Wang added a comment - IIUC for trash support, we need to be able to rename a nested EZ to the trash folder within its parent. Renaming a nested EZ within the same parent EZ seems okay to me, since we already allow renaming things within an EZ. If anything, renaming it outside of the parent EZ is more questionable, since it's currently not possible to rename anything out of an EZ. Since the contents will still be correctly interpreted I think it's okay, but did want to mention it.
        Hide
        djp Junping Du added a comment -

        Move non-critical issue out of 2.6.4 to 2.6.5.

        Show
        djp Junping Du added a comment - Move non-critical issue out of 2.6.4 to 2.6.5.
        Hide
        zhz Zhe Zhang added a comment -

        Updating the patch after HDFS-9244. There are 2 differences between the 2 versions of TestNestedEncryptionZones.java:

        1. Need to call the hooks of allowing and disallowing nested EZs
        2. An error message change because of the new logic in trunk / 2.8 of checking parent EZ.
        >     // Allow setting nested EZ temporarily
        >     cluster.getNamesystem().getFSDirectory().ezManager.setAllowNestedEZ();
        104a108
        >     cluster.getNamesystem().getFSDirectory().ezManager.setDisallowNestedEZ();
        183c187,188
        <           "can't be moved into an encryption zone"));
        ---
        >           "can't be moved from encryption zone " + topEZ2Dir.toString() +
        >               " to encryption zone"));
        

        Andrew Wang Could you take another look? Thanks!

        Show
        zhz Zhe Zhang added a comment - Updating the patch after HDFS-9244 . There are 2 differences between the 2 versions of TestNestedEncryptionZones.java : Need to call the hooks of allowing and disallowing nested EZs An error message change because of the new logic in trunk / 2.8 of checking parent EZ. > // Allow setting nested EZ temporarily > cluster.getNamesystem().getFSDirectory().ezManager.setAllowNestedEZ(); 104a108 > cluster.getNamesystem().getFSDirectory().ezManager.setDisallowNestedEZ(); 183c187,188 < "can't be moved into an encryption zone" )); --- > "can't be moved from encryption zone " + topEZ2Dir.toString() + > " to encryption zone" )); Andrew Wang Could you take another look? Thanks!
        Hide
        zhz Zhe Zhang added a comment -

        I also updated target versions to the maint releases of 2.6 and 2.7. Excluding 2.8 because both nested EZ (HDFS-9244) and Trash support (HDFS-8831) are in 2.8 release. This is supposed to be a travel-to-the-past unit test.

        Show
        zhz Zhe Zhang added a comment - I also updated target versions to the maint releases of 2.6 and 2.7. Excluding 2.8 because both nested EZ ( HDFS-9244 ) and Trash support ( HDFS-8831 ) are in 2.8 release. This is supposed to be a travel-to-the-past unit test.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 21s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        -1 mvninstall 0m 39s root in branch-2.7 failed.
        -1 compile 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72.
        -1 compile 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95.
        +1 checkstyle 0m 10s branch-2.7 passed
        -1 mvnsite 0m 9s hadoop-hdfs in branch-2.7 failed.
        -1 mvneclipse 0m 11s hadoop-hdfs in branch-2.7 failed.
        -1 findbugs 0m 10s hadoop-hdfs in branch-2.7 failed.
        -1 javadoc 0m 10s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72.
        -1 javadoc 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95.
        -1 mvninstall 0m 10s hadoop-hdfs in the patch failed.
        -1 compile 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javac 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 compile 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 javac 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        +1 checkstyle 0m 8s the patch passed
        -1 mvnsite 0m 9s hadoop-hdfs in the patch failed.
        -1 mvneclipse 0m 9s hadoop-hdfs in the patch failed.
        -1 whitespace 0m 1s The patch has 1956 line(s) that end in whitespace. Use git apply --whitespace=fix.
        -1 whitespace 0m 51s The patch has 53 line(s) with tabs.
        -1 findbugs 0m 8s hadoop-hdfs in the patch failed.
        -1 javadoc 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javadoc 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 unit 0m 9s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 unit 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 asflicense 51m 53s Patch generated 56 ASF License warnings.
        58m 6s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2016-02-11
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12787553/HDFS-9688-branch-2.7.03.patch
        JIRA Issue HDFS-9688
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 9dc85d0b513d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.7 / a30043c
        Default Java 1.7.0_95
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-mvninstall-root.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/whitespace-eol.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/whitespace-tabs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14462/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 48MB
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14462/console
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 21s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvninstall 0m 39s root in branch-2.7 failed. -1 compile 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72. -1 compile 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95. +1 checkstyle 0m 10s branch-2.7 passed -1 mvnsite 0m 9s hadoop-hdfs in branch-2.7 failed. -1 mvneclipse 0m 11s hadoop-hdfs in branch-2.7 failed. -1 findbugs 0m 10s hadoop-hdfs in branch-2.7 failed. -1 javadoc 0m 10s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72. -1 javadoc 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95. -1 mvninstall 0m 10s hadoop-hdfs in the patch failed. -1 compile 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javac 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 compile 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 javac 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 checkstyle 0m 8s the patch passed -1 mvnsite 0m 9s hadoop-hdfs in the patch failed. -1 mvneclipse 0m 9s hadoop-hdfs in the patch failed. -1 whitespace 0m 1s The patch has 1956 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 0m 51s The patch has 53 line(s) with tabs. -1 findbugs 0m 8s hadoop-hdfs in the patch failed. -1 javadoc 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javadoc 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 unit 0m 9s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 unit 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 asflicense 51m 53s Patch generated 56 ASF License warnings. 58m 6s Subsystem Report/Notes Docker Image:yetus/hadoop:date2016-02-11 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12787553/HDFS-9688-branch-2.7.03.patch JIRA Issue HDFS-9688 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 9dc85d0b513d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.7 / a30043c Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-mvninstall-root.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14462/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14462/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 48MB Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14462/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        zhz Zhe Zhang added a comment -

        Attaching a duplicate patch, renamed with 2.8 suffix to work with Yetus.

        Show
        zhz Zhe Zhang added a comment - Attaching a duplicate patch, renamed with 2.8 suffix to work with Yetus.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        -1 patch 0m 5s HDFS-9688 does not apply to branch-2.8. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



        Subsystem Report/Notes
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12787571/HDFS-9688-branch-2.8.03.patch
        JIRA Issue HDFS-9688
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14466/console
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 patch 0m 5s HDFS-9688 does not apply to branch-2.8. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12787571/HDFS-9688-branch-2.8.03.patch JIRA Issue HDFS-9688 Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14466/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        andrew.wang Andrew Wang added a comment -

        This looks good overall, but what are we going to do about precommit? IIUC from Allen's comment, we just need to bring the docker stuff in branch-2.8+ to branch-2.7 and branch-2.6. I'm fairly confident the same docker image will work for these older releases.

        Show
        andrew.wang Andrew Wang added a comment - This looks good overall, but what are we going to do about precommit? IIUC from Allen's comment, we just need to bring the docker stuff in branch-2.8+ to branch-2.7 and branch-2.6. I'm fairly confident the same docker image will work for these older releases.
        Hide
        andrew.wang Andrew Wang added a comment -

        The other thing is that we might add a test for deleting nested EZs, if we're going to rev anyway. Not a blocker though, since we have those tests attached to HDFS-9244.

        Show
        andrew.wang Andrew Wang added a comment - The other thing is that we might add a test for deleting nested EZs, if we're going to rev anyway. Not a blocker though, since we have those tests attached to HDFS-9244 .
        Hide
        zhz Zhe Zhang added a comment -

        So you mean complete deletion of nested EZs (instead of deleting into Trash)?

        Show
        zhz Zhe Zhang added a comment - So you mean complete deletion of nested EZs (instead of deleting into Trash)?
        Hide
        zhz Zhe Zhang added a comment -

        Thanks Andrew for the suggestion re:pre-commit. I think it's worthwhile copying the docker image and enabling 2.6/2.7 patches to be tested. I'll work on that.

        Show
        zhz Zhe Zhang added a comment - Thanks Andrew for the suggestion re:pre-commit. I think it's worthwhile copying the docker image and enabling 2.6/2.7 patches to be tested. I'll work on that.
        Hide
        zhz Zhe Zhang added a comment -

        Created HADOOP-12800 to address the docker file issue.

        Show
        zhz Zhe Zhang added a comment - Created HADOOP-12800 to address the docker file issue.
        Hide
        zhz Zhe Zhang added a comment -

        Attaching a duplicate patch as HDFS-9688-branch-2.7.03.patch. Since HADOOP-12800 is in, precommit should work.

        Show
        zhz Zhe Zhang added a comment - Attaching a duplicate patch as HDFS-9688 -branch-2.7.03.patch . Since HADOOP-12800 is in, precommit should work.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 6m 37s branch-2.7 passed
        +1 compile 1m 13s branch-2.7 passed with JDK v1.8.0_72
        +1 compile 1m 0s branch-2.7 passed with JDK v1.7.0_95
        +1 checkstyle 0m 24s branch-2.7 passed
        +1 mvnsite 1m 2s branch-2.7 passed
        +1 mvneclipse 0m 13s branch-2.7 passed
        -1 findbugs 3m 4s hadoop-hdfs-project/hadoop-hdfs in branch-2.7 has 1 extant Findbugs warnings.
        +1 javadoc 1m 24s branch-2.7 passed with JDK v1.8.0_72
        +1 javadoc 1m 59s branch-2.7 passed with JDK v1.7.0_95
        +1 mvninstall 0m 52s the patch passed
        +1 compile 1m 8s the patch passed with JDK v1.8.0_72
        +1 javac 1m 8s the patch passed
        +1 compile 0m 59s the patch passed with JDK v1.7.0_95
        +1 javac 0m 59s the patch passed
        +1 checkstyle 0m 21s the patch passed
        +1 mvnsite 0m 57s the patch passed
        +1 mvneclipse 0m 11s the patch passed
        -1 whitespace 0m 0s The patch has 3197 line(s) that end in whitespace. Use git apply --whitespace=fix.
        -1 whitespace 1m 2s The patch has 107 line(s) with tabs.
        +1 findbugs 3m 10s the patch passed
        +1 javadoc 1m 14s the patch passed with JDK v1.8.0_72
        +1 javadoc 1m 53s the patch passed with JDK v1.7.0_95
        -1 unit 51m 8s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 unit 47m 1s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 asflicense 45m 30s Patch generated 80 ASF License warnings.
        175m 13s



        Reason Tests
        JDK v1.8.0_72 Failed junit tests hadoop.hdfs.server.datanode.TestFsDatasetCache
          hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
          hadoop.hdfs.server.namenode.TestFileTruncate
        JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
          hadoop.hdfs.server.datanode.TestBlockReplacement
          hadoop.hdfs.web.TestWebHdfsTokens



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:c420dfe
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12788775/HDFS-9688-branch-2.7.04.patch
        JIRA Issue HDFS-9688
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux e3eb8be9b724 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.7 / c420dfe
        Default Java 1.7.0_95
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
        findbugs v3.0.0
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/whitespace-eol.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/whitespace-tabs.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14548/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14548/console
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 37s branch-2.7 passed +1 compile 1m 13s branch-2.7 passed with JDK v1.8.0_72 +1 compile 1m 0s branch-2.7 passed with JDK v1.7.0_95 +1 checkstyle 0m 24s branch-2.7 passed +1 mvnsite 1m 2s branch-2.7 passed +1 mvneclipse 0m 13s branch-2.7 passed -1 findbugs 3m 4s hadoop-hdfs-project/hadoop-hdfs in branch-2.7 has 1 extant Findbugs warnings. +1 javadoc 1m 24s branch-2.7 passed with JDK v1.8.0_72 +1 javadoc 1m 59s branch-2.7 passed with JDK v1.7.0_95 +1 mvninstall 0m 52s the patch passed +1 compile 1m 8s the patch passed with JDK v1.8.0_72 +1 javac 1m 8s the patch passed +1 compile 0m 59s the patch passed with JDK v1.7.0_95 +1 javac 0m 59s the patch passed +1 checkstyle 0m 21s the patch passed +1 mvnsite 0m 57s the patch passed +1 mvneclipse 0m 11s the patch passed -1 whitespace 0m 0s The patch has 3197 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 1m 2s The patch has 107 line(s) with tabs. +1 findbugs 3m 10s the patch passed +1 javadoc 1m 14s the patch passed with JDK v1.8.0_72 +1 javadoc 1m 53s the patch passed with JDK v1.7.0_95 -1 unit 51m 8s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 unit 47m 1s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 asflicense 45m 30s Patch generated 80 ASF License warnings. 175m 13s Reason Tests JDK v1.8.0_72 Failed junit tests hadoop.hdfs.server.datanode.TestFsDatasetCache   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.namenode.TestFileTruncate JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.web.TestWebHdfsTokens Subsystem Report/Notes Docker Image:yetus/hadoop:c420dfe JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12788775/HDFS-9688-branch-2.7.04.patch JIRA Issue HDFS-9688 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux e3eb8be9b724 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.7 / c420dfe Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14548/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14548/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14548/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        zhz Zhe Zhang added a comment -

        It seems the added Dockerfile worked. All reported test failures are unrelated and pass locally. Andrew Wang Could you take another look at the patch? Thanks.

        Show
        zhz Zhe Zhang added a comment - It seems the added Dockerfile worked. All reported test failures are unrelated and pass locally. Andrew Wang Could you take another look at the patch? Thanks.
        Hide
        andrew.wang Andrew Wang added a comment -

        LGTM +1 thanks Zhe!

        Show
        andrew.wang Andrew Wang added a comment - LGTM +1 thanks Zhe!
        Hide
        zhz Zhe Zhang added a comment -

        Thanks Andrew for the review! I just committed the patch to branch-2.7 and branch-2.6.

        Show
        zhz Zhe Zhang added a comment - Thanks Andrew for the review! I just committed the patch to branch-2.7 and branch-2.6.
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        Closing the JIRA as part of 2.7.3 release.

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - Closing the JIRA as part of 2.7.3 release.
        Hide
        ctrezzo Chris Trezzo added a comment - - edited

        Hi Zhe Zhang Andrew Wang. TestNestedEncryptionZones#testNestedEncryptionZones seems to be failing in branch-2.6.5 with the following error message:

        java.lang.AssertionError: Should be able to rename the root dir of an EZ.
        	at org.junit.Assert.fail(Assert.java:88)
        	at org.apache.hadoop.hdfs.server.namenode.TestNestedEncryptionZones.testNestedEncryptionZones(TestNestedEncryptionZones.java:194)
        
        2016-09-16 23:09:42,930 INFO  ipc.Server (Server.java:run(2061)) - IPC Server handler 9 on 60066, call org.apache.hadoop.hdfs.protocol.ClientProtocol.rename from 127.0.0.1:48977 Call#195 Retry#0
        java.io.IOException: /topEZ/renamedFile can't be moved from encryption zone /topEZ to encryption zone /topEZ/nestedEZ.
        	at org.apache.hadoop.hdfs.server.namenode.EncryptionZoneManager.checkMoveValidity(EncryptionZoneManager.java:285)
        	at org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedRenameTo(FSDirectory.java:563)
        	at org.apache.hadoop.hdfs.server.namenode.FSDirectory.renameTo(FSDirectory.java:477)
        	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renameToInternal(FSNamesystem.java:3857)
        	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renameToInt(FSNamesystem.java:3819)
        	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renameTo(FSNamesystem.java:3784)
        	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.rename(NameNodeRpcServer.java:787)
        	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.rename(ClientNamenodeProtocolServerSideTranslatorPB.java:565)
        	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
        	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619)
        	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:975)
        	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040)
        	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036)
        	at java.security.AccessController.doPrivileged(Native Method)
        	at javax.security.auth.Subject.doAs(Subject.java:415)
        	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
        	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034)
        

        I can reproduce this on my local machine as well. I am currently investigating this. Does this failure ring any bells? I also see that this passes on branch-2.7 and branch-2.7.3. Thanks!

        Show
        ctrezzo Chris Trezzo added a comment - - edited Hi Zhe Zhang Andrew Wang . TestNestedEncryptionZones#testNestedEncryptionZones seems to be failing in branch-2.6.5 with the following error message: java.lang.AssertionError: Should be able to rename the root dir of an EZ. at org.junit.Assert.fail(Assert.java:88) at org.apache.hadoop.hdfs.server.namenode.TestNestedEncryptionZones.testNestedEncryptionZones(TestNestedEncryptionZones.java:194) 2016-09-16 23:09:42,930 INFO ipc.Server (Server.java:run(2061)) - IPC Server handler 9 on 60066, call org.apache.hadoop.hdfs.protocol.ClientProtocol.rename from 127.0.0.1:48977 Call#195 Retry#0 java.io.IOException: /topEZ/renamedFile can't be moved from encryption zone /topEZ to encryption zone /topEZ/nestedEZ. at org.apache.hadoop.hdfs.server.namenode.EncryptionZoneManager.checkMoveValidity(EncryptionZoneManager.java:285) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedRenameTo(FSDirectory.java:563) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.renameTo(FSDirectory.java:477) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renameToInternal(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renameToInt(FSNamesystem.java:3819) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renameTo(FSNamesystem.java:3784) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.rename(NameNodeRpcServer.java:787) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.rename(ClientNamenodeProtocolServerSideTranslatorPB.java:565) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:975) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) I can reproduce this on my local machine as well. I am currently investigating this. Does this failure ring any bells? I also see that this passes on branch-2.7 and branch-2.7.3. Thanks!
        Hide
        xyao Xiaoyu Yao added a comment -

        Chris Trezzo, move the the root of encryption zone is allowed from Hadoop 2.7 by HDFS-7530 but not Hadoop 2.6.
        The test should have passed if you backport HDFS-7530 to branch-2.6.5.

        Show
        xyao Xiaoyu Yao added a comment - Chris Trezzo , move the the root of encryption zone is allowed from Hadoop 2.7 by HDFS-7530 but not Hadoop 2.6. The test should have passed if you backport HDFS-7530 to branch-2.6.5.
        Hide
        ctrezzo Chris Trezzo added a comment -

        Thanks for the pointer to HDFS-7530 Xiaoyu Yao!

        Show
        ctrezzo Chris Trezzo added a comment - Thanks for the pointer to HDFS-7530 Xiaoyu Yao !

          People

          • Assignee:
            zhz Zhe Zhang
            Reporter:
            zhz Zhe Zhang
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development