Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2339

Move sub-directory might fail in append mode

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.5
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:
      None

      Description

      In append mode, Sqoop will first create dataset in a temporary directory and then move it target directory. I noticed that if the temporary directory contains sub-directory and the target directory has a same directory, the import might fail with an IOException. This will happen in old hadoop distribution such as hadoop-2.0.4-alpha.

      There is no problem with hadoop-2.5.0. With hadoop-2.5.0, duplicated directory will be renamed by adding a suffix "-0000" (the digit might be increased).

        Attachments

        1. SQOOP-2339.patch
          6 kB
          Qian Xu

          Issue Links

            Activity

              People

              • Assignee:
                stanleyxu2005 Qian Xu
                Reporter:
                stanleyxu2005 Qian Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: