Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12907

Allow read-only access to reserved raw for non-superusers

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.6.0
    • 3.1.0, 2.10.0, 2.9.1, 3.0.1, 2.8.4
    • namenode
    • None
    • Reviewed

    Description

      HDFS-6509 added a special /.reserved/raw path prefix to access the raw file contents of EZ files. In the simplest sense it doesn't return the FE info in the LocatedBlocks so the dfs client doesn't try to decrypt the data. This facilitates allowing tools like distcp to copy raw bytes.

      Access to the raw hierarchy is restricted to superusers. This seems like an overly broad restriction designed to prevent non-admins from munging the EZ related xattrs. I believe we should relax the restriction to allow non-admins to perform read-only operations. Allowing non-superusers to easily read the raw bytes will be extremely useful for regular users, esp. for enabling webhdfs client-side encryption.

      Attachments

        1. HDFS-12907.patch
          2 kB
          Rushabh Shah
        2. HDFS-12907.001.patch
          3 kB
          Rushabh Shah
        3. HDFS-12907.002.patch
          5 kB
          Rushabh Shah
        4. HDFS-12907.003.patch
          11 kB
          Rushabh Shah
        5. HDFS-12907.004.patch
          11 kB
          Rushabh Shah
        6. HDFS-12907.branch-2.004.patch
          11 kB
          Rushabh Shah

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shahrs87 Rushabh Shah
            daryn Daryn Sharp
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment