Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2339

Move sub-directory might fail in append mode

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.5
    • 1.4.7
    • None
    • None

    Description

      In append mode, Sqoop will first create dataset in a temporary directory and then move it target directory. I noticed that if the temporary directory contains sub-directory and the target directory has a same directory, the import might fail with an IOException. This will happen in old hadoop distribution such as hadoop-2.0.4-alpha.

      There is no problem with hadoop-2.5.0. With hadoop-2.5.0, duplicated directory will be renamed by adding a suffix "-0000" (the digit might be increased).

      Attachments

        1. SQOOP-2339.patch
          6 kB
          Qian Xu

        Issue Links

          Activity

            People

              stanleyxu2005 Qian Xu
              stanleyxu2005 Qian Xu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment