Sqoop
  1. Sqoop
  2. SQOOP-373

Can only write to default file system on direct import

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0-incubating
    • Component/s: None
    • Labels:
      None

      Description

      The implementation of 'sqoop import --direct' fails if your --directory option points to a directory that is not in fs.default.name (such as a fully qualified path to s3n). When doing so the output is:
      ERROR tool.ImportTool: Imported Failed: Wrong FS: s3n://bucket/, expected: hdfs://server/

        Activity

        Hide
        Mark Roddy added a comment -

        Patch enables the ability to use s3 as the destination of a direct import.

        Show
        Mark Roddy added a comment - Patch enables the ability to use s3 as the destination of a direct import.
        Hide
        Bilung Lee added a comment -

        Patch committed. Thanks, Mark!

        Show
        Bilung Lee added a comment - Patch committed. Thanks, Mark!
        Hide
        Hudson added a comment -

        Integrated in Sqoop-jdk-1.6 #56 (See https://builds.apache.org/job/Sqoop-jdk-1.6/56/)
        SQOOP-373 Can only write to default file system on direct import

        blee : http://svn.apache.org/viewvc/?view=rev&rev=1196980
        Files :

        • /incubator/sqoop/trunk/src/java/org/apache/sqoop/io/SplittingOutputStream.java
        • /incubator/sqoop/trunk/src/java/org/apache/sqoop/util/DirectImportUtils.java
        Show
        Hudson added a comment - Integrated in Sqoop-jdk-1.6 #56 (See https://builds.apache.org/job/Sqoop-jdk-1.6/56/ ) SQOOP-373 Can only write to default file system on direct import blee : http://svn.apache.org/viewvc/?view=rev&rev=1196980 Files : /incubator/sqoop/trunk/src/java/org/apache/sqoop/io/SplittingOutputStream.java /incubator/sqoop/trunk/src/java/org/apache/sqoop/util/DirectImportUtils.java

          People

          • Assignee:
            Mark Roddy
            Reporter:
            Mark Roddy
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development