Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-3136

Sqoop should work well with not default file systems

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.5
    • Fix Version/s: 1.4.7
    • Component/s: connectors/hdfs
    • Labels:
      None

      Description

      Currently Sqoop assumes default file system when it comes to IO operations. It makes it hard to use other FileSystem implementations as source or destination. Here is an example:

      sqoop import --connect <JDBC CONNECTION> --table table1 --driver <JDBC DRIVER> --username root --password **** --delete-target-dir --target-dir s3a://some-bucket/tmp/sqoop
      ...
      17/02/15 19:16:59 ERROR tool.ImportTool: Imported Failed: Wrong FS: s3a://some-bucket/tmp/sqoop, expected: hdfs://<DNS>:8020
      

        Attachments

        1. SQOOP-3136.patch
          24 kB
          Illya Yalovyy

          Issue Links

            Activity

              People

              • Assignee:
                yalovyyi Illya Yalovyy
                Reporter:
                yalovyyi Illya Yalovyy
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: