Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8180

AbstractFileSystem Implementation for WebHdfs

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: webhdfs
    • Labels:
    • Hadoop Flags:
      Reviewed
    • Flags:
      Patch

      Description

      Add AbstractFileSystem implementation for WebHdfs to support FileContext APIs.

      1. HDFS-8180-1.patch
        36 kB
        Santhosh G Nayak
      2. HDFS-8180-2.patch
        17 kB
        Santhosh G Nayak
      3. HDFS-8180-3.patch
        15 kB
        Santhosh G Nayak
      4. HDFS-8180-4.patch
        18 kB
        Santhosh G Nayak

        Issue Links

          Activity

          Hide
          snayak Santhosh G Nayak added a comment -

          Attaching 1st version of the Patch.

          Show
          snayak Santhosh G Nayak added a comment - Attaching 1st version of the Patch.
          Hide
          snayak Santhosh G Nayak added a comment -

          Adding 2 new classes,
          1. org.apache.hadoop.fs.SWebHdfs
          2. org.apache.hadoop.fs.WebHdfs
          by extending DelegateToFileSystem class.
          Also added the AFS Contract Tests for those.

          Show
          snayak Santhosh G Nayak added a comment - Adding 2 new classes, 1. org.apache.hadoop.fs.SWebHdfs 2. org.apache.hadoop.fs.WebHdfs by extending DelegateToFileSystem class. Also added the AFS Contract Tests for those.
          Hide
          stevel@apache.org Steve Loughran added a comment -
          1. Why the choice of "SWebHDFS" as the name/scheme?
          2. there's no entries in hdfs-default.xml for the new implementations —aren't they needed
          3. I like the number of tests -but how do they wire up to an HDFS cluster implementing webhdfs? I'd have expected something like the HDFS contract tests, which create a mini cluster, and TestWebHdfsFileSystemContract which does the same
          Show
          stevel@apache.org Steve Loughran added a comment - Why the choice of "SWebHDFS" as the name/scheme? there's no entries in hdfs-default.xml for the new implementations —aren't they needed I like the number of tests -but how do they wire up to an HDFS cluster implementing webhdfs? I'd have expected something like the HDFS contract tests, which create a mini cluster, and TestWebHdfsFileSystemContract which does the same
          Hide
          snayak Santhosh G Nayak added a comment -

          1. swebhdfs is an existing scheme, It will be more intuitive if we name AFS implementation of swebhdfs as SWebHdfs. Any thoughts?

          2. Added the following entries in the core-default.xml, where AFS implementations are configured for most of the schemes.

          <property>
              <name>fs.AbstractFileSystem.webhdfs.impl</name>
              <value>org.apache.hadoop.fs.WebHdfs</value>
              <description>The FileSystem for webhdfs: uris.</description>
            </property>
          
            <property>
              <name>fs.AbstractFileSystem.swebhdfs.impl</name>
              <value>org.apache.hadoop.fs.SWebHdfs</value>
              <description>The FileSystem for swebhdfs: uris.</description>
            </property>
          

          3. Removed the FileSystem contract tests from the patch and added FileContext tests, as AFS implementation is required mainly to support FileContext APIs. It creates a MiniDFSCluster and runs the FileContextMainOperationsBaseTest tests.

          Show
          snayak Santhosh G Nayak added a comment - 1. swebhdfs is an existing scheme, It will be more intuitive if we name AFS implementation of swebhdfs as SWebHdfs . Any thoughts? 2. Added the following entries in the core-default.xml, where AFS implementations are configured for most of the schemes. <property> <name> fs.AbstractFileSystem.webhdfs.impl </name> <value> org.apache.hadoop.fs.WebHdfs </value> <description> The FileSystem for webhdfs: uris. </description> </property> <property> <name> fs.AbstractFileSystem.swebhdfs.impl </name> <value> org.apache.hadoop.fs.SWebHdfs </value> <description> The FileSystem for swebhdfs: uris. </description> </property> 3. Removed the FileSystem contract tests from the patch and added FileContext tests, as AFS implementation is required mainly to support FileContext APIs. It creates a MiniDFSCluster and runs the FileContextMainOperationsBaseTest tests.
          Hide
          jghoman Jakob Homan added a comment -

          Hey Santhosh-
          Thanks for the update. A couple minor changes and I'll be ready to commit this:

          • The two tests have quite a lot (say 70%) of duplicated code. Can we have TestSWebHdfsFileContextMainOperations extend TestWebHdfsFileContextMainOperations? This is particularly true since there are comments about the need to add more testing/verification on WebHDFS versus HDFS behavior in both tests. Not sure if you'll run into problems with the JUnit @BeforeClass annotations. If so, just go ahead and split out the common code to another, non-test class.
          • The comments about WebHDFS/HDFS behavior are formatted incorrectly and run into their function definitions:
              @Test
              /** Test FileContext APIs when symlinks are not supported
               * TODO: Open separate JIRA for full support of the Symlink in webhdfs
               * */ public void testUnsupportedSymlink() throws IOException {
          • Typo: clusterSetupAtBegining > clusterSetupAtBeginning
          Show
          jghoman Jakob Homan added a comment - Hey Santhosh- Thanks for the update. A couple minor changes and I'll be ready to commit this: The two tests have quite a lot (say 70%) of duplicated code. Can we have TestSWebHdfsFileContextMainOperations extend TestWebHdfsFileContextMainOperations? This is particularly true since there are comments about the need to add more testing/verification on WebHDFS versus HDFS behavior in both tests. Not sure if you'll run into problems with the JUnit @BeforeClass annotations. If so, just go ahead and split out the common code to another, non-test class. The comments about WebHDFS/HDFS behavior are formatted incorrectly and run into their function definitions: @Test /** Test FileContext APIs when symlinks are not supported * TODO: Open separate JIRA for full support of the Symlink in webhdfs * */ public void testUnsupportedSymlink() throws IOException { Typo: clusterSetupAtBegining > clusterSetupAtBeginning
          Hide
          snayak Santhosh G Nayak added a comment -

          Thanks Jakob Homan for reviewing.
          Updated the patch as per the review comments.

          Show
          snayak Santhosh G Nayak added a comment - Thanks Jakob Homan for reviewing. Updated the patch as per the review comments.
          Hide
          jghoman Jakob Homan added a comment -

          Submitting patch to be picked up by Jenkins. For some reason the submit patch button wasn't showing up for me until I assigned the JIRA to myself. Not sure why.

          Show
          jghoman Jakob Homan added a comment - Submitting patch to be picked up by Jenkins. For some reason the submit patch button wasn't showing up for me until I assigned the JIRA to myself. Not sure why.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 18m 36s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 36s There were no new javac warning messages.
          +1 javadoc 9m 38s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 2m 29s The applied patch generated 2 new checkstyle issues (total was 0, now 2).
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 19s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 4m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 22m 21s Tests passed in hadoop-common.
          -1 hdfs tests 160m 36s Tests failed in hadoop-hdfs.
              227m 55s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            hadoop.hdfs.TestDistributedFileSystem



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12747089/HDFS-8180-3.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 83fe34a
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/11835/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/11835/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11835/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11835/testReport/
          Java 1.7.0_55
          uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11835/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 18m 36s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 36s There were no new javac warning messages. +1 javadoc 9m 38s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 2m 29s The applied patch generated 2 new checkstyle issues (total was 0, now 2). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 19s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 4m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 22m 21s Tests passed in hadoop-common. -1 hdfs tests 160m 36s Tests failed in hadoop-hdfs.     227m 55s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.hdfs.TestDistributedFileSystem Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12747089/HDFS-8180-3.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 83fe34a checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/11835/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/11835/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11835/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11835/testReport/ Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11835/console This message was automatically generated.
          Hide
          jghoman Jakob Homan added a comment -

          The failed unit tests pass for me, I'm assuming the failures were transient. Santhosh G Nayak, can you fix the checkstyle errors Jenkins flagged and we'll commit this?

          Show
          jghoman Jakob Homan added a comment - The failed unit tests pass for me, I'm assuming the failures were transient. Santhosh G Nayak , can you fix the checkstyle errors Jenkins flagged and we'll commit this?
          Hide
          snayak Santhosh G Nayak added a comment -

          Thanks Jakob Homan. Uploading the patch version 4 with check style fixes.

          Show
          snayak Santhosh G Nayak added a comment - Thanks Jakob Homan . Uploading the patch version 4 with check style fixes.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 16m 59s Findbugs (version ) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 42s There were no new javac warning messages.
          +1 javadoc 9m 44s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 40s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 25s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 22m 38s Tests passed in hadoop-common.
          +1 hdfs tests 162m 26s Tests passed in hadoop-hdfs.
              228m 5s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12747599/HDFS-8180-4.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f170934
          hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/11855/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11855/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11855/testReport/
          Java 1.7.0_55
          uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11855/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 16m 59s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 42s There were no new javac warning messages. +1 javadoc 9m 44s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 40s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 25s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 22m 38s Tests passed in hadoop-common. +1 hdfs tests 162m 26s Tests passed in hadoop-hdfs.     228m 5s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12747599/HDFS-8180-4.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f170934 hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/11855/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11855/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11855/testReport/ Java 1.7.0_55 uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11855/console This message was automatically generated.
          Hide
          jghoman Jakob Homan added a comment -

          +1

          Show
          jghoman Jakob Homan added a comment - +1
          Hide
          jghoman Jakob Homan added a comment -

          I've committed this. Resolving. Thanks, Santhosh!

          Show
          jghoman Jakob Homan added a comment - I've committed this. Resolving. Thanks, Santhosh!
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8234 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8234/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8234 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8234/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/main/resources/core-default.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #271 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/271/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #271 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/271/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #1001 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1001/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1001 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1001/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java hadoop-common-project/hadoop-common/src/main/resources/core-default.xml hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2198 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2198/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2198 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2198/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #260 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/260/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #260 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/260/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java hadoop-common-project/hadoop-common/src/main/resources/core-default.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #268 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/268/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #268 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/268/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/main/resources/core-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2217 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2217/)
          HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2217 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2217/ ) HDFS-8180 . AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. (jghoman: rev 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/SWebHdfs.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/main/resources/core-default.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/WebHdfs.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/fs/package.html hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileContextMainOperationsBaseTest.java
          Hide
          cnauroth Chris Nauroth added a comment -

          This patch introduced a test failure on Windows, which has since been fixed in HDFS-9128.

          Show
          cnauroth Chris Nauroth added a comment - This patch introduced a test failure on Windows, which has since been fixed in HDFS-9128 .

            People

            • Assignee:
              snayak Santhosh G Nayak
              Reporter:
              snayak Santhosh G Nayak
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development