Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9394

branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: hdfs-client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      On branch-2, hadoop-hdfs-client contains a FileSystem service descriptor that lists HftpFileSystem and HsftpFileSystem. These classes do not reside in hadoop-hdfs-client. Instead, they reside in hadoop-hdfs. If the application has hadoop-hdfs-client.jar on the classpath, but not hadoop-hdfs.jar, then this can cause a ServiceConfigurationError.

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2521 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2521/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2521 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2521/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #582 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/582/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #582 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/582/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2581 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2581/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2581 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2581/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #641 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/641/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #641 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/641/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          liuml07 Mingliang Liu added a comment -

          Thanks for reporting this jira, reviewing and committing the patch, Chris Nauroth.

          Show
          liuml07 Mingliang Liu added a comment - Thanks for reporting this jira, reviewing and committing the patch, Chris Nauroth .
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1374 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1374/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1374 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1374/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #651 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/651/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #651 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/651/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8772 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8772/)
          HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8772 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8772/ ) HDFS-9394 . branch-2 hadoop-hdfs-client fails during FileSystem (cnauroth: rev 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          cnauroth Chris Nauroth added a comment -

          I have committed this to branch-2. Mingliang, thank you for contributing the patch.

          Test org.apache.hadoop.hdfs.TestRollingUpgradeRollback fails in branch-2.

          Yes, it looks like this was already failing on branch-2 before this patch. I'll file a separate issue to track this.

          Show
          cnauroth Chris Nauroth added a comment - I have committed this to branch-2. Mingliang, thank you for contributing the patch. Test org.apache.hadoop.hdfs.TestRollingUpgradeRollback fails in branch-2. Yes, it looks like this was already failing on branch-2 before this patch. I'll file a separate issue to track this.
          Hide
          liuml07 Mingliang Liu added a comment -

          Test org.apache.hadoop.hdfs.TestRollingUpgradeRollback fails in branch-2. All other tests can pass locally. Seem unrelated?

          Show
          liuml07 Mingliang Liu added a comment - Test org.apache.hadoop.hdfs.TestRollingUpgradeRollback fails in branch-2. All other tests can pass locally. Seem unrelated?
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 10s docker + precommit patch detected.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 7m 8s branch-2 passed
          +1 compile 0m 59s branch-2 passed with JDK v1.8.0_60
          +1 compile 0m 56s branch-2 passed with JDK v1.7.0_79
          +1 checkstyle 0m 22s branch-2 passed
          +1 mvneclipse 0m 32s branch-2 passed
          -1 findbugs 1m 54s hadoop-hdfs-project/hadoop-hdfs in branch-2 has 1 extant Findbugs warnings.
          -1 findbugs 1m 46s hadoop-hdfs-project/hadoop-hdfs-client in branch-2 has 5 extant Findbugs warnings.
          +1 javadoc 1m 28s branch-2 passed with JDK v1.8.0_60
          +1 javadoc 2m 13s branch-2 passed with JDK v1.7.0_79
          -1 mvninstall 0m 21s hadoop-hdfs in the patch failed.
          +1 compile 0m 57s the patch passed with JDK v1.8.0_60
          +1 javac 0m 57s the patch passed
          +1 compile 0m 55s the patch passed with JDK v1.7.0_79
          +1 javac 0m 55s the patch passed
          +1 checkstyle 0m 19s the patch passed
          +1 mvneclipse 0m 26s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 3m 56s the patch passed
          +1 javadoc 1m 23s the patch passed with JDK v1.8.0_60
          +1 javadoc 2m 9s the patch passed with JDK v1.7.0_79
          -1 unit 54m 40s hadoop-hdfs in the patch failed with JDK v1.8.0_60.
          +1 unit 1m 3s hadoop-hdfs-client in the patch passed with JDK v1.8.0_60.
          -1 unit 64m 11s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
          +1 unit 1m 10s hadoop-hdfs-client in the patch passed with JDK v1.7.0_79.
          -1 asflicense 0m 25s Patch generated 58 ASF License warnings.
          152m 43s



          Reason Tests
          JDK v1.8.0_60 Failed junit tests hadoop.hdfs.server.namenode.TestCacheDirectives
            hadoop.hdfs.TestRollingUpgradeRollback
            hadoop.hdfs.TestDistributedFileSystem
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
          JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
            hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            hadoop.hdfs.shortcircuit.TestShortCircuitCache
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.hdfs.TestRollingUpgradeRollback
            hadoop.hdfs.TestDistributedFileSystem



          Subsystem Report/Notes
          Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-11-06
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12771085/HDFS-9394.000.branch-2.patch
          JIRA Issue HDFS-9394
          Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile
          uname Linux 56670a93a1dd 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-ee5baeb/precommit/personality/hadoop.sh
          git revision branch-2 / 481e724
          Default Java 1.7.0_79
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
          findbugs v3.0.0
          findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
          findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client-warnings.html
          mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
          JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13423/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project
          Max memory used 214MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13423/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 7m 8s branch-2 passed +1 compile 0m 59s branch-2 passed with JDK v1.8.0_60 +1 compile 0m 56s branch-2 passed with JDK v1.7.0_79 +1 checkstyle 0m 22s branch-2 passed +1 mvneclipse 0m 32s branch-2 passed -1 findbugs 1m 54s hadoop-hdfs-project/hadoop-hdfs in branch-2 has 1 extant Findbugs warnings. -1 findbugs 1m 46s hadoop-hdfs-project/hadoop-hdfs-client in branch-2 has 5 extant Findbugs warnings. +1 javadoc 1m 28s branch-2 passed with JDK v1.8.0_60 +1 javadoc 2m 13s branch-2 passed with JDK v1.7.0_79 -1 mvninstall 0m 21s hadoop-hdfs in the patch failed. +1 compile 0m 57s the patch passed with JDK v1.8.0_60 +1 javac 0m 57s the patch passed +1 compile 0m 55s the patch passed with JDK v1.7.0_79 +1 javac 0m 55s the patch passed +1 checkstyle 0m 19s the patch passed +1 mvneclipse 0m 26s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 3m 56s the patch passed +1 javadoc 1m 23s the patch passed with JDK v1.8.0_60 +1 javadoc 2m 9s the patch passed with JDK v1.7.0_79 -1 unit 54m 40s hadoop-hdfs in the patch failed with JDK v1.8.0_60. +1 unit 1m 3s hadoop-hdfs-client in the patch passed with JDK v1.8.0_60. -1 unit 64m 11s hadoop-hdfs in the patch failed with JDK v1.7.0_79. +1 unit 1m 10s hadoop-hdfs-client in the patch passed with JDK v1.7.0_79. -1 asflicense 0m 25s Patch generated 58 ASF License warnings. 152m 43s Reason Tests JDK v1.8.0_60 Failed junit tests hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.TestRollingUpgradeRollback   hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.TestRollingUpgradeRollback   hadoop.hdfs.TestDistributedFileSystem Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-11-06 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12771085/HDFS-9394.000.branch-2.patch JIRA Issue HDFS-9394 Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile uname Linux 56670a93a1dd 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-ee5baeb/precommit/personality/hadoop.sh git revision branch-2 / 481e724 Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client-warnings.html mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13423/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13423/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project Max memory used 214MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13423/console This message was automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          +1 for the patch, pending pre-commit run. I verified locally that the hadoop-hdfs-client tests pass on branch-2 after applying this patch.

          Show
          cnauroth Chris Nauroth added a comment - +1 for the patch, pending pre-commit run. I verified locally that the hadoop-hdfs-client tests pass on branch-2 after applying this patch.
          Hide
          liuml07 Mingliang Liu added a comment -

          Thank you Chris Nauroth for reporting this. As Haohui Mai said, when we separated the classes to hadoop-hdfs-client, we tried to address this in HDFS-9166. I think the original patch should work just fine, but it was probably not fully committed.

          Hopefully the fix is simple. Let's see if the v0 patch works.

          Show
          liuml07 Mingliang Liu added a comment - Thank you Chris Nauroth for reporting this. As Haohui Mai said, when we separated the classes to hadoop-hdfs-client , we tried to address this in HDFS-9166 . I think the original patch should work just fine, but it was probably not fully committed. Hopefully the fix is simple. Let's see if the v0 patch works.
          Hide
          wheat9 Haohui Mai added a comment -

          Thanks for reporting, Chris Nauroth! I though HDFS-9166 has addressed the issue but apparently it didn't.

          I'll file a jira to fix them.

          Show
          wheat9 Haohui Mai added a comment - Thanks for reporting, Chris Nauroth ! I though HDFS-9166 has addressed the issue but apparently it didn't. I'll file a jira to fix them.
          Hide
          cnauroth Chris Nauroth added a comment -

          The easiest way to see this problem is to run the hadoop-hdfs-client tests on branch-2. Several of the tests will fail like this:

          Running org.apache.hadoop.fs.TestUrlStreamHandlerFactory
          Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.2 sec <<< FAILURE! - in org.apache.hadoop.fs.TestUrlStreamHandlerFactory
          testConcurrency(org.apache.hadoop.fs.TestUrlStreamHandlerFactory)  Time elapsed: 0.148 sec  <<< ERROR!
          java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.hdfs.web.HftpFileSystem not found
          	at java.util.ServiceLoader.fail(ServiceLoader.java:231)
          	at java.util.ServiceLoader.access$300(ServiceLoader.java:181)
          	at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:365)
          	at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
          	at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2662)
          	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2673)
          	at org.apache.hadoop.fs.FsUrlStreamHandlerFactory.<init>(FsUrlStreamHandlerFactory.java:62)
          	at org.apache.hadoop.fs.FsUrlStreamHandlerFactory.<init>(FsUrlStreamHandlerFactory.java:55)
          	at org.apache.hadoop.fs.TestUrlStreamHandlerFactory.singleRun(TestUrlStreamHandlerFactory.java:48)
          	at org.apache.hadoop.fs.TestUrlStreamHandlerFactory.testConcurrency(TestUrlStreamHandlerFactory.java:43)
          

          This also implies that end users wouldn't be successful in depending on hadoop-hdfs-client only. They'd still have to get hadoop-hdfs.jar onto the classpath as a workaround.

          This is not a problem on trunk, where HftpFileSystem and HsftpFileSystem have been removed.

          FYI Mingliang Liu and Haohui Mai. Thanks!

          Show
          cnauroth Chris Nauroth added a comment - The easiest way to see this problem is to run the hadoop-hdfs-client tests on branch-2. Several of the tests will fail like this: Running org.apache.hadoop.fs.TestUrlStreamHandlerFactory Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.2 sec <<< FAILURE! - in org.apache.hadoop.fs.TestUrlStreamHandlerFactory testConcurrency(org.apache.hadoop.fs.TestUrlStreamHandlerFactory) Time elapsed: 0.148 sec <<< ERROR! java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.hdfs.web.HftpFileSystem not found at java.util.ServiceLoader.fail(ServiceLoader.java:231) at java.util.ServiceLoader.access$300(ServiceLoader.java:181) at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:365) at java.util.ServiceLoader$1.next(ServiceLoader.java:445) at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2662) at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2673) at org.apache.hadoop.fs.FsUrlStreamHandlerFactory.<init>(FsUrlStreamHandlerFactory.java:62) at org.apache.hadoop.fs.FsUrlStreamHandlerFactory.<init>(FsUrlStreamHandlerFactory.java:55) at org.apache.hadoop.fs.TestUrlStreamHandlerFactory.singleRun(TestUrlStreamHandlerFactory.java:48) at org.apache.hadoop.fs.TestUrlStreamHandlerFactory.testConcurrency(TestUrlStreamHandlerFactory.java:43) This also implies that end users wouldn't be successful in depending on hadoop-hdfs-client only. They'd still have to get hadoop-hdfs.jar onto the classpath as a workaround. This is not a problem on trunk, where HftpFileSystem and HsftpFileSystem have been removed. FYI Mingliang Liu and Haohui Mai . Thanks!

            People

            • Assignee:
              liuml07 Mingliang Liu
              Reporter:
              cnauroth Chris Nauroth
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development