Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2880

Provide argument for overriding temporary directory

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.6
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:
      None

      Description

      Several types of imports (incremental, hive, ...) might require import into temporary directory first. We're currently putting the temporary directory into _sqoop and we're allowing user to override it with sqoop.test.import.rootDir. However this property is not documented anywhere and I found people confused about it as it contains the string test which is really confusing. The most concerning thing is that as the properties are not persisted in metastore, this option won't work for stored jobs at all. Hence I would like to propose a first class argument to handle the temporary directory (e.g. something like --temporary-directory).

        Attachments

        1. SQOOP-2880.patch
          8 kB
          Attila Szabo
        2. SQOOP-2880_review_1.patch
          8 kB
          Attila Szabo

          Issue Links

            Activity

              People

              • Assignee:
                maugli Attila Szabo
                Reporter:
                jarcec Jarek Jarcec Cecho
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: