Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2943

Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.4.7
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:
      None

      Description

      If HDFS encryption zones are turned on, and the user tries to import into Parquet format, where the target location is in a very different encryption zone, than the zone of the /tmp/ location (typical use case for that encrypted hive warehouse directory), even the mapper jobs are executed successfully, and the partial results stored on the temp storage correctly, the MergeOutputMapper class of Kite SDK dies with an HDFS related exception ("can't be moved into an encryption zone").

      The problem does not appear in case of clear text output formats.

      Please make Sqoop able to solve this scenario as well!

        Issue Links

          Activity

          Hide
          markuskemper@me.com Markus Kemper added a comment -

          Linking SQOOP-2880

          Show
          markuskemper@me.com Markus Kemper added a comment - Linking SQOOP-2880

            People

            • Assignee:
              Unassigned
              Reporter:
              maugli Attila Szabo
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Development