[SQOOP-443] Calling sqoop with hive import is not working multiple times due to kept output directory

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.4.0-incubating, 1.4.1-incubating
• Fix Version/s: 1.4.2
• Assignee: Jarek Jarcec Cecho
• Reporter: Jarek Jarcec Cecho
• Created: 18/Feb/12 19:04
• Updated: 05/May/12 08:16
• Resolved: 05/May/12 07:27

Description

Hive is not removing input directory when doing "LOAD DATA" command in all cases. This input directory is actually sqoop's export directory. Because this directory is kept, calling same sqoop command twice is failing on exception "org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory $table already exists".

This issue might be easily overcome by manual directory removal, however it's putting unnecessary burden on users. It's also complicating executing saved jobs as there is additional script execution needed.