Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2943

Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.4.7
    • Fix Version/s: 1.5.0
    • Component/s: None
    • Labels:
      None

      Description

      If HDFS encryption zones are turned on, and the user tries to import into Parquet format, where the target location is in a very different encryption zone, than the zone of the /tmp/ location (typical use case for that encrypted hive warehouse directory), even the mapper jobs are executed successfully, and the partial results stored on the temp storage correctly, the MergeOutputMapper class of Kite SDK dies with an HDFS related exception ("can't be moved into an encryption zone").

      The problem does not appear in case of clear text output formats.

      Please make Sqoop able to solve this scenario as well!

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                maugli Attila Szabo
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: