Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15763

Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.3.0
    • Fix Version/s: None
    • Component/s: fs/azure
    • Labels:
      None

      Description

      ABFS phase II: address issues which surface in the field; tune things which need tuning, add more tests where appropriate. Improve docs, especially troubleshooting. Classpaths. The usual.

        Attachments

          Issue Links

          1.
          ABFS checkException to map 403 to AccessDeniedException Sub-task Open Unassigned
          2.
          intermittent failure of TestAbfsClient.validateUserAgent Sub-task Open Unassigned
          3.
          Review/implement ABFS support for the extra fs ops which some apps (HBase) expects Sub-task Open Unassigned
          4.
          ABFS: Increase timeout of ITestAbfsReadWriteAndSeek Sub-task Reopened Da Zhou
          5.
          ABFS: Better exception handling of DNS errors Sub-task Resolved Da Zhou
          6.
          ABFS: validate packing, transient classpath, hadoop fs CLI Sub-task Resolved Steve Loughran
          7.
          Document ABFS Sub-task Resolved Thomas Marquardt
          8.
          typo in AzureBlobFileSystem.getIsNamespaceEnabeld Sub-task Resolved Abhishek Modi
          9.
          Make HTTPS the default protocol for ABFS Sub-task Resolved Da Zhou
          10.
          ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console Sub-task Resolved Da Zhou
          11.
          ABFS: Stop requiring client ID and tenant ID for MSI Sub-task Resolved Da Zhou
          12.
          ABFS: Enable some tests for namespace not enabled account using OAuth Sub-task Resolved Da Zhou
          13.
          ABFS: change createRemoteFileSystemDuringInitialization default to true Sub-task Resolved Sean Mackrory
          14.
          ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries. Sub-task Resolved junhua gu
          15.
          ABFS: Throw IllegalArgumentException when Directory/File name ends with a period(.) Sub-task Resolved Shweta
          16.
          ABFS to support a Delegation Token provider which marshalls current Oauth secrets Sub-task Open Unassigned
          17.
          Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore Sub-task Resolved Da Zhou
          18.
          ABFS: make retry policy configurable Sub-task Resolved Da Zhou
          19.
          ABFS: For HNS account, avoid unnecessary get call when doing Rename Sub-task Resolved Da Zhou
          20.
          ABFS: replace $superuser with local user Sub-task Resolved Da Zhou
          21.
          ABFS: Enable owner and group conversion for MSI and login user using OAuth Sub-task Resolved Da Zhou
          22.
          ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2 Sub-task Resolved junhua gu
          23.
          Add ABFS support for Async Scatter/Gather IO Sub-task Open Unassigned
          24.
          ABFS: add try catch for UGI failure when initializing ABFS Sub-task Resolved Da Zhou
          25.
          ABFS: getNamespaceEnabled can fail blocking user access thru ACLs Sub-task Resolved Da Zhou
          26.
          ABFS: reduce list page size to to 500 Sub-task Resolved Da Zhou
          27.
          ABFS: remove timeout check for DELETE and RENAME Sub-task Resolved Da Zhou
          28.
          ABFS: Convert 404 error response in AbfsInputStream and AbfsOutPutStream to FileNotFoundException Sub-task Resolved Da Zhou
          29.
          ABFS: Bug fix for tolerateOobAppends configuration Sub-task Resolved Da Zhou
          30.
          UserAgent string for ABFS Sub-task Resolved Shweta
          31.
          ABFS: Better exception handling of DNS errors followup Sub-task Resolved Da Zhou
          32.
          ABFS: Fix Date format parser Sub-task Resolved Da Zhou
          33.
          ABFS Authentication and Delegation Token plugins to optionally be bound to specific URI of the store Sub-task Resolved Steve Loughran
          34.
          NativeAzureFileSystem does not support setXAttr Sub-task Open Clemens Wolff
          35.
          Failure of ABFS test ITestAbfsIdentityTransformer Sub-task Resolved Steve Loughran
          36.
          Wasb tests to downgrade to skip when test a/c is namespace enabled Sub-task Resolved Masatake Iwasaki
          37.
          ABFS: Should only transform username to short name Sub-task Resolved Da Zhou
          38.
          hadoop fs mkdir / of nonexistent abfs container raises NPE Sub-task In Progress Gabor Bota
          39.
          NPE in ABFS Client Credential Auth Sub-task Resolved Steve Loughran
          40.
          NPE in setup/teardown of ITestAbfsDelegationTokens Sub-task Resolved Steve Loughran
          41.
          ABFS: Bug fix for getPathProperties Sub-task Resolved Da Zhou
          42.
          Update abfs storage back-end with "close" flag when application is done writing to a file Sub-task Resolved Vishwajeet Dusane
          43.
          ABFS tests to include terasort Sub-task Open Unassigned
          44.
          ABFS VersionedFileStatus to declare that it isEncrypted() Sub-task Patch Available Masatake Iwasaki
          45.
          ABFS: add bufferpool to AbfsOutputStream Sub-task Resolved Da Zhou
          46.
          ABFS: add FSMainOperationsBaseTest Sub-task Resolved Da Zhou
          47.
          ABFS: add listFileStatus with StartFrom Sub-task Resolved Da Zhou
          48.
          ABFS: Rename operation, GetFileStatus before rename operation and throw exception on the driver side Sub-task Open Da Zhou
          49.
          ABFS: transform full UPN for named user in AclStatus Sub-task Patch Available Da Zhou
          50.
          ABFS: improve random read performance Sub-task Open Unassigned
          51.
          ABFS driver continues to retry on IOException responses from REST operations Sub-task Resolved Robert Levas
          52.
          ABFS: Override access() to no-op for now Sub-task Resolved Da Zhou
          53.
          ABFS: port Azure doc to 3.2 branch Sub-task Resolved Masatake Iwasaki
          54.
          ABFS default blocksize change(256MB from 512MB) Sub-task Resolved Arun Singh
          55.
          abfs can't access storage account without password Sub-task Open Masatake Iwasaki

            Activity

              People

              • Assignee:
                DanielZhou Da Zhou
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: