Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17879

Unable to use custom SAS tokens for accessing files from ADLS gen2 storage accounts with hierarchical namespace enabled.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • fs/azure, tools
    • None

    Description

      I have some parquet files in abfss://con@sa1.dfs.core.windows.net/folder1/. I generated the User Delegation SAS token with the following permission on 'folder1'

      SAS_SIGNED_PERMISSIONS -> "racwdxltmeop"

      But when I read from "abfss://con@sa1.dfs.core.windows.net/folder1/"

      I get a HTTP 403 error, I believe this happens when ABFSS driver makes use of `getACLStatus` API call to determine whether the storage service has hierarchical namespace enabled or not.

       

      I found a workaround, ie to set fs.azure.account.hns.enabled to true which would skip get ACL API call and as folder level SAS only works for HNS enabled accounts. May I know if this behavior is expected and the workaround I am using is stable for production use and if there are any hidden implications?

       

      Thank you in advance. 

      Attachments

        Activity

          People

            Unassigned Unassigned
            arunravimv Arun Ravi M V
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: