Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18341

Add repl load support for adding "raw" namespace for TDE with same encryption keys

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersStop watchingWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • None

    Description

      https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html#Running_as_the_superuser

      "a new virtual path prefix, /.reserved/raw/, that gives superusers direct access to the underlying block data in the filesystem. This allows superusers to distcp data without needing having access to encryption keys, and also avoids the overhead of decrypting and re-encrypting data."

      We need to introduce a new option in "Repl Load" command that will change the files being copied in distcp to have this "/.reserved/raw/" namespace before the file paths.

      Attachments

        1. HIVE-18341.3.patch
          16 kB
          Anishek Agarwal
        2. HIVE-18341.2.patch
          16 kB
          Anishek Agarwal
        3. HIVE-18341.1.patch
          16 kB
          Anishek Agarwal
        4. HIVE-18341.0.patch
          11 kB
          Anishek Agarwal

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            anishek Anishek Agarwal Assign to me
            anishek Anishek Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment