Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9815

Move o.a.h.fs.Hdfs to hadoop-hdfs-client

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      the o.a.h.fs.Hdfs is used by the FileContext API. It should belong to the hadoop-hdfs-client module.

        Issue Links

          Activity

          Hide
          wheat9 Haohui Mai added a comment -

          Marking this as a blocker of 2.8.0 as it prevents downstream clients that uses the FileContext API to directly depend on the hadoop-hdfs-client module.

          Show
          wheat9 Haohui Mai added a comment - Marking this as a blocker of 2.8.0 as it prevents downstream clients that uses the FileContext API to directly depend on the hadoop-hdfs-client module.
          Hide
          vinayrpet Vinayakumar B added a comment -

          Attaching patch for moving all AbstractFileSystem impls

          Show
          vinayrpet Vinayakumar B added a comment - Attaching patch for moving all AbstractFileSystem impls
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 14s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 23s Maven dependency ordering for branch
          +1 mvninstall 8m 45s trunk passed
          +1 compile 2m 12s trunk passed with JDK v1.8.0_72
          +1 compile 1m 47s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 32s trunk passed
          +1 mvnsite 1m 53s trunk passed
          +1 mvneclipse 0m 28s trunk passed
          +1 findbugs 4m 13s trunk passed
          +1 javadoc 1m 57s trunk passed with JDK v1.8.0_72
          +1 javadoc 2m 48s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 10s Maven dependency ordering for patch
          +1 mvninstall 1m 38s the patch passed
          +1 compile 2m 13s the patch passed with JDK v1.8.0_72
          +1 javac 2m 13s the patch passed
          +1 compile 1m 46s the patch passed with JDK v1.7.0_95
          -1 javac 5m 47s hadoop-hdfs-project-jdk1.7.0_95 with JDK v1.7.0_95 generated 2 new + 49 unchanged - 2 fixed = 51 total (was 51)
          +1 javac 1m 46s the patch passed
          +1 checkstyle 0m 30s hadoop-hdfs-project: patch generated 0 new + 16 unchanged - 1 fixed = 16 total (was 17)
          +1 mvnsite 1m 44s the patch passed
          +1 mvneclipse 0m 25s the patch passed
          -1 whitespace 0m 0s The patch has 35 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 findbugs 4m 46s the patch passed
          +1 javadoc 2m 2s the patch passed with JDK v1.8.0_72
          +1 javadoc 2m 39s the patch passed with JDK v1.7.0_95
          +1 unit 1m 13s hadoop-hdfs-client in the patch passed with JDK v1.8.0_72.
          -1 unit 90m 56s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
          +1 unit 1m 10s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 84m 26s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 asflicense 0m 25s Patch does not generate ASF License warnings.
          224m 11s



          Reason Tests
          JDK v1.8.0_72 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
            hadoop.hdfs.server.datanode.TestDataNodeMetrics
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.server.namenode.TestDecommissioningStatus
            hadoop.hdfs.server.datanode.TestDirectoryScanner
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.TestDFSUpgradeFromImage
            hadoop.hdfs.TestErasureCodeBenchmarkThroughput
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.hdfs.server.datanode.TestBlockReplacement
            hadoop.fs.viewfs.TestViewFsHdfs
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs
            hadoop.hdfs.server.datanode.TestDirectoryScanner



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12788033/HDFS-9815-01.patch
          JIRA Issue HDFS-9815
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux a43ed81dc24e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 8ed07bd
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          javac hadoop-hdfs-project-jdk1.7.0_95: https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/diff-compile-javac-hadoop-hdfs-project-jdk1.7.0_95.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/whitespace-eol.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14504/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14504/console
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 14s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 23s Maven dependency ordering for branch +1 mvninstall 8m 45s trunk passed +1 compile 2m 12s trunk passed with JDK v1.8.0_72 +1 compile 1m 47s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 32s trunk passed +1 mvnsite 1m 53s trunk passed +1 mvneclipse 0m 28s trunk passed +1 findbugs 4m 13s trunk passed +1 javadoc 1m 57s trunk passed with JDK v1.8.0_72 +1 javadoc 2m 48s trunk passed with JDK v1.7.0_95 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 38s the patch passed +1 compile 2m 13s the patch passed with JDK v1.8.0_72 +1 javac 2m 13s the patch passed +1 compile 1m 46s the patch passed with JDK v1.7.0_95 -1 javac 5m 47s hadoop-hdfs-project-jdk1.7.0_95 with JDK v1.7.0_95 generated 2 new + 49 unchanged - 2 fixed = 51 total (was 51) +1 javac 1m 46s the patch passed +1 checkstyle 0m 30s hadoop-hdfs-project: patch generated 0 new + 16 unchanged - 1 fixed = 16 total (was 17) +1 mvnsite 1m 44s the patch passed +1 mvneclipse 0m 25s the patch passed -1 whitespace 0m 0s The patch has 35 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 findbugs 4m 46s the patch passed +1 javadoc 2m 2s the patch passed with JDK v1.8.0_72 +1 javadoc 2m 39s the patch passed with JDK v1.7.0_95 +1 unit 1m 13s hadoop-hdfs-client in the patch passed with JDK v1.8.0_72. -1 unit 90m 56s hadoop-hdfs in the patch failed with JDK v1.8.0_72. +1 unit 1m 10s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 84m 26s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 25s Patch does not generate ASF License warnings. 224m 11s Reason Tests JDK v1.8.0_72 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.TestFileAppend   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.hdfs.server.datanode.TestDirectoryScanner JDK v1.7.0_95 Failed junit tests hadoop.hdfs.TestDFSUpgradeFromImage   hadoop.hdfs.TestErasureCodeBenchmarkThroughput   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.fs.viewfs.TestViewFsHdfs   hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12788033/HDFS-9815-01.patch JIRA Issue HDFS-9815 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux a43ed81dc24e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 8ed07bd Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 javac hadoop-hdfs-project-jdk1.7.0_95: https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/diff-compile-javac-hadoop-hdfs-project-jdk1.7.0_95.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/whitespace-eol.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14504/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14504/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14504/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          liuml07 Mingliang Liu added a comment -

          The change is straightforward for me to +1 (non-binding).

          Show
          liuml07 Mingliang Liu added a comment - The change is straightforward for me to +1 (non-binding).
          Hide
          wheat9 Haohui Mai added a comment -

          +1. I'll commit it shortly.

          Show
          wheat9 Haohui Mai added a comment - +1. I'll commit it shortly.
          Hide
          wheat9 Haohui Mai added a comment -

          I've committed the patch to trunk, branch-2 and branch-2.8. Thanks Vinayakumar B for the contribution.

          Show
          wheat9 Haohui Mai added a comment - I've committed the patch to trunk, branch-2 and branch-2.8. Thanks Vinayakumar B for the contribution.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #9313 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9313/)
          HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by (wheat9: rev 77f7ca3e94ecaa442c007b12d4ad773b37da097c)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/Hdfs.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/Hdfs.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9313 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9313/ ) HDFS-9815 . Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by (wheat9: rev 77f7ca3e94ecaa442c007b12d4ad773b37da097c) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/Hdfs.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/fs/package.html hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/Hdfs.java
          Hide
          vinayrpet Vinayakumar B added a comment -
          Show
          vinayrpet Vinayakumar B added a comment - Thanks Haohui Mai and Mingliang Liu .

            People

            • Assignee:
              vinayrpet Vinayakumar B
              Reporter:
              wheat9 Haohui Mai
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development