Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14764

Über-jira adl:// Azure Data Lake Phase II: Performance, Resilience and Testing

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: fs/adl
    • Labels:
      None
    • Target Version/s:

      Description

      Uber-JIRA for adl:// phase II

      • Split out integration tests
      • Parallel test execution
      • More metrics
      • Performance optimizations
      • Performance tuning docs

        Attachments

          Issue Links

          1.
          ADLS should differentiate integration tests from contract tests Sub-task Open Unassigned
          2.
          AdlFsInputStream should implement unbuffer Sub-task Open Unassigned
          3.
          Metrics for AdlFileSystem Sub-task Open Unassigned
          4.
          AdlFileSystem should support getStorageStatistics Sub-task Open Unassigned
          5.
          Add ADLS telemetry instrumentation Sub-task Open Vishwajeet Dusane
          6.
          Add HTrace to ADLS connector Sub-task Open Unassigned
          7.
          Rename ADLS mountpoint properties Sub-task Open Rohan Garg
          8.
          AdlStoreClient#getExceptionFromResponse should not swallow defaultMessage Sub-task Open Atul Sikaria
          9.
          ADL To map container 403 to AccessDeniedException Sub-task Open Atul Sikaria
          10.
          Print better error when accessing a non-existent ADL store Sub-task Open Atul Sikaria
          11.
          NPE when ADL store URI contains underscore Sub-task Open Xiaobing Zhou
          12.
          Add Kerberos and Delegation token support to ADLS client Sub-task Open Santhosh G Nayak
          13.
          Azure: Add Authorization support to ADLS Sub-task Patch Available Sivaguru Sankaridurg
          14.
          Verify viewfs works with ADLS Sub-task Open Unassigned
          15.
          Verify and document ADLS client mount table feature Sub-task Open Unassigned
          16.
          ADLS to implement AbstractContractDistCpTest Sub-task Open Unassigned
          17.
          [Azure Data Lake] Support for process level FileStatus cache to optimize GetFileStatus frequent operations Sub-task Open Vishwajeet Dusane
          18.
          ADLS to implement FileSystemContractBaseTest Sub-task Open Unassigned
          19.
          Add ADL troubleshooting doc Sub-task Resolved Steve Loughran
          20.
          AdlFileSystem.getAclStatus() returns unexpected ACL information Sub-task Open Unassigned
          21.
          ADL TestAdlContractRenameLive.testRenameFileUnderFile failing Sub-task Open Unassigned
          22.
          adl:// to stop using Configuration.getPassword() to look up fs.adl.oauth2.refresh.url Sub-task Open Unassigned

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jzhuge John Zhuge
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: