Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10809

getNumEncryptionZones causes NPE in branch-2.7

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.4
    • Fix Version/s: 2.7.4
    • Component/s: encryption, namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      This bug was caused by the fact that we did HDFS-10458 from trunk to branch-2.7, but we did HDFS-8721 initially up to branch-2.8. So from branch-2.8 and up, the order is HDFS-8721 -> HDFS-10458. But in branch-2.7, we have the reverse order. Hence the inconsistency.

        Issue Links

          Activity

          Hide
          redvine Vinitha Reddy Gankidi added a comment -

          Zhe Zhang I have uploaded a patch. Please take a look.

          Show
          redvine Vinitha Reddy Gankidi added a comment - Zhe Zhang I have uploaded a patch. Please take a look.
          Hide
          zhz Zhe Zhang added a comment -

          Thanks Vinitha Reddy Gankidi. Is the patch based on branch-2.7? If so could you rename it so Yetus knows how to apply it?

          Based on HowToContribute it should be something like HDFS-10809-branch-2.7.00.patch

          Show
          zhz Zhe Zhang added a comment - Thanks Vinitha Reddy Gankidi . Is the patch based on branch-2.7? If so could you rename it so Yetus knows how to apply it? Based on HowToContribute it should be something like HDFS-10809 -branch-2.7.00.patch
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 15m 49s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 14s branch-2.7 passed
          +1 compile 0m 59s branch-2.7 passed with JDK v1.8.0_101
          +1 compile 1m 1s branch-2.7 passed with JDK v1.7.0_111
          +1 checkstyle 0m 25s branch-2.7 passed
          +1 mvnsite 1m 0s branch-2.7 passed
          +1 mvneclipse 0m 15s branch-2.7 passed
          +1 findbugs 2m 59s branch-2.7 passed
          +1 javadoc 0m 58s branch-2.7 passed with JDK v1.8.0_101
          +1 javadoc 1m 40s branch-2.7 passed with JDK v1.7.0_111
          +1 mvninstall 0m 53s the patch passed
          +1 compile 0m 55s the patch passed with JDK v1.8.0_101
          +1 javac 0m 55s the patch passed
          +1 compile 0m 58s the patch passed with JDK v1.7.0_111
          +1 javac 0m 58s the patch passed
          +1 checkstyle 0m 20s the patch passed
          +1 mvnsite 0m 57s the patch passed
          +1 mvneclipse 0m 13s the patch passed
          -1 whitespace 0m 0s The patch has 1275 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 34s The patch 70 line(s) with tabs.
          +1 findbugs 3m 10s the patch passed
          +1 javadoc 0m 56s the patch passed with JDK v1.8.0_101
          +1 javadoc 1m 38s the patch passed with JDK v1.7.0_111
          -1 unit 55m 53s hadoop-hdfs in the patch failed with JDK v1.7.0_111.
          -1 asflicense 0m 27s The patch generated 3 ASF License warnings.
          160m 56s



          Reason Tests
          JDK v1.8.0_101 Failed junit tests hadoop.hdfs.server.namenode.ha.TestDNFencing
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
          JDK v1.7.0_111 Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.TestSafeMode
            hadoop.hdfs.TestDatanodeRegistration
            hadoop.hdfs.server.namenode.TestFileTruncate



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:c420dfe
          JIRA Issue HDFS-10809
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826137/HDFS-10809-branch-2.7.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 6f7a5710a3f8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2.7 / 32a86f1
          Default Java 1.7.0_111
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_101 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111
          findbugs v3.0.0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/whitespace-tabs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_111.txt
          JDK v1.7.0_111 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/16573/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/16573/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 15m 49s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 14s branch-2.7 passed +1 compile 0m 59s branch-2.7 passed with JDK v1.8.0_101 +1 compile 1m 1s branch-2.7 passed with JDK v1.7.0_111 +1 checkstyle 0m 25s branch-2.7 passed +1 mvnsite 1m 0s branch-2.7 passed +1 mvneclipse 0m 15s branch-2.7 passed +1 findbugs 2m 59s branch-2.7 passed +1 javadoc 0m 58s branch-2.7 passed with JDK v1.8.0_101 +1 javadoc 1m 40s branch-2.7 passed with JDK v1.7.0_111 +1 mvninstall 0m 53s the patch passed +1 compile 0m 55s the patch passed with JDK v1.8.0_101 +1 javac 0m 55s the patch passed +1 compile 0m 58s the patch passed with JDK v1.7.0_111 +1 javac 0m 58s the patch passed +1 checkstyle 0m 20s the patch passed +1 mvnsite 0m 57s the patch passed +1 mvneclipse 0m 13s the patch passed -1 whitespace 0m 0s The patch has 1275 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 34s The patch 70 line(s) with tabs. +1 findbugs 3m 10s the patch passed +1 javadoc 0m 56s the patch passed with JDK v1.8.0_101 +1 javadoc 1m 38s the patch passed with JDK v1.7.0_111 -1 unit 55m 53s hadoop-hdfs in the patch failed with JDK v1.7.0_111. -1 asflicense 0m 27s The patch generated 3 ASF License warnings. 160m 56s Reason Tests JDK v1.8.0_101 Failed junit tests hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot JDK v1.7.0_111 Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.TestSafeMode   hadoop.hdfs.TestDatanodeRegistration   hadoop.hdfs.server.namenode.TestFileTruncate Subsystem Report/Notes Docker Image:yetus/hadoop:c420dfe JIRA Issue HDFS-10809 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826137/HDFS-10809-branch-2.7.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 6f7a5710a3f8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.7 / 32a86f1 Default Java 1.7.0_111 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_101 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111 findbugs v3.0.0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_111.txt JDK v1.7.0_111 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/16573/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/16573/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/16573/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          zhz Zhe Zhang added a comment -

          Thanks Vinitha. +1 on the patch. Reported test failures are not related and I verified that none can be reproduced locally. I'm committing the patch to branch-2.7 soon.

          Show
          zhz Zhe Zhang added a comment - Thanks Vinitha. +1 on the patch. Reported test failures are not related and I verified that none can be reproduced locally. I'm committing the patch to branch-2.7 soon.
          Hide
          zhz Zhe Zhang added a comment -

          Just committed the patch. Thanks Vinitha Reddy Gankidi for the contribution.

          Show
          zhz Zhe Zhang added a comment - Just committed the patch. Thanks Vinitha Reddy Gankidi for the contribution.
          Hide
          redvine Vinitha Reddy Gankidi added a comment -

          Thanks Zhe Zhang. I could not reproduce the test failures locally as well.

          Show
          redvine Vinitha Reddy Gankidi added a comment - Thanks Zhe Zhang . I could not reproduce the test failures locally as well.

            People

            • Assignee:
              redvine Vinitha Reddy Gankidi
              Reporter:
              zhz Zhe Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development