Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2943

Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.4.7
    • 1.5.0
    • None
    • None

    Description

      If HDFS encryption zones are turned on, and the user tries to import into Parquet format, where the target location is in a very different encryption zone, than the zone of the /tmp/ location (typical use case for that encrypted hive warehouse directory), even the mapper jobs are executed successfully, and the partial results stored on the temp storage correctly, the MergeOutputMapper class of Kite SDK dies with an HDFS related exception ("can't be moved into an encryption zone").

      The problem does not appear in case of clear text output formats.

      Please make Sqoop able to solve this scenario as well!

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. SQOOP-3313 Remove Kite dependency

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SQOOP-2880 Provide argument for overriding temporary directory

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              maugli Attila Szabo
              Votes:
              2 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: