[SQOOP-3136] Sqoop should work well with not default file systems

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.5
• Fix Version/s: 1.4.7
• Component/s: connectors/hdfs
• Assignee: Illya Yalovyy
• Reporter: Illya Yalovyy
• Created: 16/Feb/17 21:47
• Updated: 16/Jun/17 04:25
• Resolved: 24/Feb/17 06:42

Description

Currently Sqoop assumes default file system when it comes to IO operations. It makes it hard to use other FileSystem implementations as source or destination. Here is an example:

sqoop import --connect <JDBC CONNECTION> --table table1 --driver <JDBC DRIVER> --username root --password **** --delete-target-dir --target-dir s3a://some-bucket/tmp/sqoop
...
17/02/15 19:16:59 ERROR tool.ImportTool: Imported Failed: Wrong FS: s3a://some-bucket/tmp/sqoop, expected: hdfs://<DNS>:8020

Issue Links

• links to: Review Board

Sub-Tasks

• Fix Java7 compile issue (getTypeName is only available after Java 8): Resolved