Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19092 ABFS phase 4: post Hadoop 3.4.0 features
  3. HADOOP-16842

abfs can't access storage account if soft delete is enabled

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.3
    • None
    • fs/azure

    Description

      Facing the issue in which if soft delete is enabled on storage account.

      Hadoop fs -ls command fails with 

       Operation failed: "This endpoint does not support BlobStorageEvents or SoftDelete. Please disable these account features if you would like to use this endpoint.", 409, HEAD, https://<account_name>.[dfs.core.windows.net/test-container-1//?upn=false&action=getAccessControl&timeout=90|http://dfs.core.windows.net/test-container-1//?upn=false&action=getAccessControl&timeout=90]
      

      Trying to access storage account by issuing below command :

       hadoop fs -Dfs.azure.account.auth.type.<account_name>.[dfs.core.windows.net|http://dfs.core.windows.net/]=OAuth -Dfs.azure.account.oauth.provider.type.<account_name>.[dfs.core.windows.net|http://dfs.core.windows.net/]=org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider -ls [abfs://test-container-1]@<account_name>.[dfs.core.windows.net/|http://dfs.core.windows.net/]
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            raghvendras Raghvendra Singh
            Votes:
            3 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: