Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2232

Sqoop2: Test initializer against local filesystem

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.99.6
    • Component/s: sqoop2-hdfs-connector
    • Labels:
      None

      Description

      TestToInitializer.testWorkDirectoryBeingSet fails for me giving exceptions about FIleSystem not existing. This is because it's looking for HDFS. The unit tests should not have this dependency.

      org.apache.sqoop.common.SqoopException: GENERIC_HDFS_CONNECTOR_0007:Invalid output directory - Unexpected exception
      	at org.apache.sqoop.connector.hdfs.HdfsToInitializer.initialize(HdfsToInitializer.java:70)
      	at org.apache.sqoop.connector.hdfs.HdfsToInitializer.initialize(HdfsToInitializer.java:35)
      	at org.apache.sqoop.connector.hdfs.TestToInitializer.testOutputDirectoryIsAFile(TestToInitializer.java:72)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
      	at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
      	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
      	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
      	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
      	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
      	at org.testng.TestRunner.privateRun(TestRunner.java:767)
      	at org.testng.TestRunner.run(TestRunner.java:617)
      	at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
      	at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:343)
      	at org.testng.SuiteRunner.privateRun(SuiteRunner.java:305)
      	at org.testng.SuiteRunner.run(SuiteRunner.java:254)
      	at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
      	at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
      	at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
      	at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
      	at org.testng.TestNG.run(TestNG.java:1057)
      	at org.testng.remote.RemoteTestNG.run(RemoteTestNG.java:111)
      	at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:204)
      	at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:175)
      	at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:125)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
      Caused by: java.io.IOException: No FileSystem for scheme: hdfs
      	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
      	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
      	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
      	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
      	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
      	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
      	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
      	at org.apache.sqoop.connector.hdfs.HdfsToInitializer.initialize(HdfsToInitializer.java:54)
      	... 32 more
      

        Attachments

        1. SQOOP-2232.patch
          2 kB
          Abraham Elmahrek

          Activity

            People

            • Assignee:
              abec Abraham Elmahrek
              Reporter:
              abec Abraham Elmahrek
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: