Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13377

AliyunOSS: improvements for stabilization and optimization

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: None
    • Component/s: fs, fs/oss
    • Labels:
      None
    • Target Version/s:

      Description

      This work is to handle some stabilization issues.

        Attachments

          Issue Links

          1.
          Aliyun Connection broken when idle then 1 minutes or build than 3 hours Sub-task Resolved Genmao Yu
          2.
          AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Sub-task Resolved Genmao Yu
          3.
          AliyunOSS: Failed to read from stream when seek beyond the download size Sub-task Resolved Genmao Yu
          4.
          AliyunOSS: update oss sdk version Sub-task Resolved Genmao Yu
          5.
          AliyunOSS: Unit test failed in TestAliyunOSSContractCreate Sub-task Resolved Genmao Yu
          6.
          AliyunOSS: oss directory filestatus should use meta time Sub-task Resolved Fei Hui
          7.
          AliyunOSS: listStatus returns wrong file info Sub-task Resolved Fei Hui
          8.
          AliyunOSS: improve the performance of object metadata operation Sub-task In Progress Genmao Yu
          9.
          Aliyun OSS FileSystem contract test should implement getTestBaseDir() Sub-task Resolved Mingliang Liu
          10.
          Aliyun OSS should not use empty endpoint as default Sub-task Resolved Genmao Yu
          11.
          AliyunOSS: Implement the `createNonRecursive` operator Sub-task Resolved Genmao Yu
          12.
          AliyunOSS: Override listFiles and listLocatedStatus Sub-task Resolved Genmao Yu
          13.
          AliyunOSS:Improve oss error logging Sub-task Resolved Unassigned
          14.
          Add hadoop-aliyun as dependency of hadoop-cloud-storage Sub-task Resolved Genmao Yu
          15.
          AliyunOSS: provide one asynchronous multi-part based uploading mechanism Sub-task Resolved Genmao Yu
          16.
          AliyunOSS: provide one memory-based buffering mechanism in outpustream to oss Sub-task Open Genmao Yu
          17.
          AliyunOSS: refactor storage statistics to oss Sub-task Open Genmao Yu
          18.
          AliyunOSS: support user agent configuration and include that & Hadoop version information to oss server Sub-task Resolved Sammi Chen
          19.
          AliyunOSS: Add User-Agent header in HTTP requests to the OSS server Sub-task Resolved Genmao Yu
          20.
          AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance Sub-task Resolved wujinhu
          21.
          IOException may be thrown when read from Aliyun OSS in some case Sub-task Resolved wujinhu
          22.
          AliyunOSS: move files under a directory in parallel when rename a directory Sub-task Resolved wujinhu
          23.
          AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore Sub-task Resolved wujinhu
          24.
          AliyunOSS: Supports role based credential in URL Sub-task Resolved wujinhu
          25.
          AliyunOSS: Support Assume Roles in AliyunOSS Sub-task Resolved wujinhu
          26.
          AliyunOSS: update document for properties of multiple part download, multiple part upload and directory copy Sub-task Resolved wujinhu
          27.
          AliyunOSS: update oss-sdk version to 3.0.0 Sub-task Resolved wujinhu
          28.
          AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream Sub-task Resolved wujinhu
          29.
          AliyunOSS: fix incorrect ReadOps and WriteOps in statistics Sub-task Resolved wujinhu
          30.
          AliyunOSS: improvements for copyFile/copyDirectory and logging Sub-task Resolved wujinhu
          31.
          AliyunOSS: Remove temporary files when upload small files to OSS Sub-task Resolved wujinhu

            Activity

              People

              • Assignee:
                uncleGen Genmao Yu
                Reporter:
                uncleGen Genmao Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: