Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6826

Plugin interface to enable delegation of HDFS authorization assertions

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.1
    • Fix Version/s: 2.7.0
    • Component/s: security
    • Labels:
      None
    • Target Version/s:

      Description

      When Hbase data, HiveMetaStore data or Search data is accessed via services (Hbase region servers, HiveServer2, Impala, Solr) the services can enforce permissions on corresponding entities (databases, tables, views, columns, search collections, documents). It is desirable, when the data is accessed directly by users accessing the underlying data files (i.e. from a MapReduce job), that the permission of the data files map to the permissions of the corresponding data entity (i.e. table, column family or search collection).

      To enable this we need to have the necessary hooks in place in the NameNode to delegate authorization to an external system that can map HDFS files/directories to data entities and resolve their permissions based on the data entities permissions.

      I’ll be posting a design proposal in the next few days.

      1. HDFSPluggableAuthorizationProposal.pdf
        136 kB
        Alejandro Abdelnur
      2. HDFS-6826-idea.patch
        41 kB
        Alejandro Abdelnur
      3. HDFS-6826-idea2.patch
        57 kB
        Alejandro Abdelnur
      4. HDFSPluggableAuthorizationProposal-v2.pdf
        136 kB
        Alejandro Abdelnur
      5. HDFS-6826v3.patch
        50 kB
        Alejandro Abdelnur
      6. HDFS-6826v4.patch
        52 kB
        Alejandro Abdelnur
      7. HDFS-6826v5.patch
        52 kB
        Alejandro Abdelnur
      8. HDFS-6826v6.patch
        58 kB
        Alejandro Abdelnur
      9. HDFS-6826v7.patch
        67 kB
        Alejandro Abdelnur
      10. HDFS-6826v7.1.patch
        67 kB
        Alejandro Abdelnur
      11. HDFS-6826v7.2.patch
        67 kB
        Alejandro Abdelnur
      12. HDFS-6826v8.patch
        21 kB
        Alejandro Abdelnur
      13. HDFS-6826v7.3.patch
        68 kB
        Alejandro Abdelnur
      14. HDFS-6826v7.4.patch
        64 kB
        Alejandro Abdelnur
      15. HDFS-6826v7.5.patch
        43 kB
        Alejandro Abdelnur
      16. HDFS-6826v7.6.patch
        100 kB
        Alejandro Abdelnur
      17. HDFS-6826-permchecker.patch
        9 kB
        Daryn Sharp
      18. HDFS-6826v9.patch
        41 kB
        Alejandro Abdelnur
      19. HDFS-6826.10.patch
        47 kB
        Arun Suresh
      20. HDFS-6826.11.patch
        39 kB
        Arun Suresh
      21. HDFS-6826.12.patch
        55 kB
        Arun Suresh
      22. HDFS-6826.13.patch
        57 kB
        Arun Suresh
      23. HDFS-6826.14.patch
        57 kB
        Arun Suresh
      24. HDFS-6826.15.patch
        55 kB
        Arun Suresh
      25. HDFS-6826.16.patch
        55 kB
        Arun Suresh

        Issue Links

          Activity

            People

            • Assignee:
              Arun Suresh
              Reporter:
              Alejandro Abdelnur
            • Votes:
              1 Vote for this issue
              Watchers:
              41 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development