Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2880

Provide argument for overriding temporary directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.6
    • 1.4.7
    • None
    • None

    Description

      Several types of imports (incremental, hive, ...) might require import into temporary directory first. We're currently putting the temporary directory into _sqoop and we're allowing user to override it with sqoop.test.import.rootDir. However this property is not documented anywhere and I found people confused about it as it contains the string test which is really confusing. The most concerning thing is that as the properties are not persisted in metastore, this option won't work for stored jobs at all. Hence I would like to propose a first class argument to handle the temporary directory (e.g. something like --temporary-directory).

      Attachments

        1. SQOOP-2880.patch
          8 kB
          Attila Szabo
        2. SQOOP-2880_review_1.patch
          8 kB
          Attila Szabo

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SQOOP-2943 Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review ticket

          Activity

            People

              maugli Attila Szabo
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              6 Stop watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment