[SQOOP-2339] Move sub-directory might fail in append mode

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.5
• Fix Version/s: 1.4.7
• Assignee: Qian Xu
• Reporter: Qian Xu
• Created: 29/Apr/15 17:56
• Updated: 29/Apr/15 21:59
• Resolved: 29/Apr/15 20:37

Description

In append mode, Sqoop will first create dataset in a temporary directory and then move it target directory. I noticed that if the temporary directory contains sub-directory and the target directory has a same directory, the import might fail with an IOException. This will happen in old hadoop distribution such as hadoop-2.0.4-alpha.

There is no problem with hadoop-2.5.0. With hadoop-2.5.0, duplicated directory will be renamed by adding a suffix "-0000" (the digit might be increased).

Issue Links

• links to: Review Board Link