Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15132

Über-jira: WASB client phase III: roll-up for Hadoop 3.2

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: fs/azure
    • Labels:
      None
    • Target Version/s:

      Description

      Everything for the WASB connector for Hadoop 3.1

        Attachments

          Issue Links

          1.
          Block compaction for WASB (Block Blobs Instead of Page Blobs) Sub-task Open Georgi Chalakov  
          2.
          Hadoop-Azure Update WASB URI format to support SAS token in it. Sub-task Open Sumit Dubey

          0%

          Original Estimate - 3h
          Remaining Estimate - 3h
          3.
          WASB's file delete still throwing Blob not found exception Sub-task Open Thomas Marqardt  
          4.
          Implement isFileClosed in WASB to make Flume happy Sub-task Open Unassigned  
          5.
          Improve efficiency of WASB over page blobs Sub-task Open NITIN VERMA  
          6.
          Support WASB connections through an HTTP proxy server. Sub-task Open Unassigned  
          7.
          WASB: Expose WASB status metrics as counters in Hadoop Sub-task Open Unassigned  
          8.
          wasb to support getStorageStatistics Sub-task Open Unassigned  
          9.
          General improvements to Azure test cases Sub-task Open Unassigned  
          10.
          WASB to support high-performance commit protocol Sub-task Resolved Unassigned  
          11.
          azureFs::getFileStatus doesn't check the file system scheme and thus could throw a misleading exception. Sub-task Patch Available nijel  
          12.
          ITestAzureConcurrentOutOfBandIo failing: The MD5 value specified in the request did not match with the MD5 value calculated by the server Sub-task Open Unassigned  
          13.
          AzureNativeFileSystemStore.getDirectorySet() to use getTrimmedStrings to get directory listings Sub-task Open Unassigned  
          14.
          Azure TestClientThrottlingAnalyzer brittle Sub-task Open Unassigned  
          15.
          Wasb getFileBlockLocations() returns too many locations. Sub-task Open Steve Loughran  
          16.
          add AbstractContractRootDirectoryTest test for mkdir / ; wasb to implement the test Sub-task Patch Available Steve Loughran  
          17.
          NativeAzureFileSystem file rename is not atomic Sub-task Resolved Thomas Marqardt  
          18.
          WASB to implement copyFromLocalFile() Sub-task Open Unassigned  
          19.
          WASB to implement listFiles(Path f, boolean recursive) through flat list Sub-task Open Unassigned  
          20.
          Wasb input streams to implement CanUnbuffer Sub-task Resolved Unassigned  
          21.
          NativeAzureFileSystem.open() ignores blob container name Sub-task Open Unassigned  
          22.
          TestNativeAzureFileSystemOperationsMocked creating files in /tmp Sub-task Open Unassigned  
          23.
          Reduce memory copy in BlobOutputStreamInternal::dispatchWrite Sub-task Open Unassigned  
          24.
          NativeAzureFileSystem, AzureBlobStorageTestAccount to have useful toString() values Sub-task Patch Available Amit Singh  
          25.
          WASB exception handling to translate specific failures into specific exceptions Sub-task Open Unassigned  
          26.
          WASB test runs leak storage containers. Sub-task Open Unassigned  
          27.
          backport HADOOP-15086 rename fix to branch-2 Sub-task Resolved Thomas Marqardt  
          28.
          provide non-zero default for the Azure rename & delete thread pool sizes Sub-task Open Unassigned  
          29.
          NativeAzureFileSystemBaseTest.testModifiedTimeForFolder modification tests fail on (overloaded?) client Sub-task Open Unassigned  
          30.
          wasb FS init hangs for minutes if the container name is wrong (e.g wasb://example.azure/) Sub-task Open Unassigned  
          31.
          Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks Sub-task Resolved Esfandiar Manii  
          32.
          Make WASB listStatus messages consistent Sub-task Resolved Esfandiar Manii  

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 3h
                  3h
                  Remaining:
                  Remaining Estimate - 3h
                  3h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified