Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13377

AliyunOSS: improvements for stabilization and optimization

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha2
    • None
    • fs, fs/oss
    • None

    Description

      This work is to handle some stabilization issues.

      Attachments

        Issue Links

        1.
        Aliyun Connection broken when idle then 1 minutes or build than 3 hours Sub-task Resolved Genmao Yu   Actions
        2.
        AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Sub-task Resolved Genmao Yu   Actions
        3.
        AliyunOSS: Failed to read from stream when seek beyond the download size Sub-task Resolved Genmao Yu   Actions
        4.
        AliyunOSS: update oss sdk version Sub-task Resolved Genmao Yu   Actions
        5.
        AliyunOSS: Unit test failed in TestAliyunOSSContractCreate Sub-task Resolved Genmao Yu   Actions
        6.
        AliyunOSS: oss directory filestatus should use meta time Sub-task Resolved Hui Fei   Actions
        7.
        AliyunOSS: listStatus returns wrong file info Sub-task Resolved Hui Fei   Actions
        8.
        AliyunOSS: improve the performance of object metadata operation Sub-task In Progress Genmao Yu   Actions
        9.
        Aliyun OSS FileSystem contract test should implement getTestBaseDir() Sub-task Resolved Mingliang Liu   Actions
        10.
        Aliyun OSS should not use empty endpoint as default Sub-task Resolved Genmao Yu   Actions
        11.
        AliyunOSS: Implement the `createNonRecursive` operator Sub-task Resolved Genmao Yu   Actions
        12.
        AliyunOSS: Override listFiles and listLocatedStatus Sub-task Resolved Genmao Yu   Actions
        13.
        AliyunOSS:Improve oss error logging Sub-task Resolved Unassigned   Actions
        14.
        Add hadoop-aliyun as dependency of hadoop-cloud-storage Sub-task Resolved Genmao Yu   Actions
        15.
        AliyunOSS: provide one asynchronous multi-part based uploading mechanism Sub-task Resolved Genmao Yu   Actions
        16.
        AliyunOSS: provide one memory-based buffering mechanism in outpustream to oss Sub-task Open Genmao Yu   Actions
        17.
        AliyunOSS: refactor storage statistics to oss Sub-task Open Genmao Yu   Actions
        18.
        AliyunOSS: support user agent configuration and include that & Hadoop version information to oss server Sub-task Resolved Sammi Chen   Actions
        19.
        AliyunOSS: Add User-Agent header in HTTP requests to the OSS server Sub-task Resolved Genmao Yu   Actions
        20.
        AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance Sub-task Resolved wujinhu   Actions
        21.
        IOException may be thrown when read from Aliyun OSS in some case Sub-task Resolved wujinhu   Actions
        22.
        AliyunOSS: move files under a directory in parallel when rename a directory Sub-task Resolved wujinhu   Actions
        23.
        AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore Sub-task Resolved wujinhu   Actions
        24.
        AliyunOSS: Supports role based credential in URL Sub-task Resolved wujinhu   Actions
        25.
        AliyunOSS: Support Assume Roles in AliyunOSS Sub-task Resolved wujinhu   Actions
        26.
        AliyunOSS: update document for properties of multiple part download, multiple part upload and directory copy Sub-task Resolved wujinhu   Actions
        27.
        AliyunOSS: update oss-sdk version to 3.0.0 Sub-task Resolved wujinhu   Actions
        28.
        AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream Sub-task Resolved wujinhu   Actions
        29.
        AliyunOSS: fix incorrect ReadOps and WriteOps in statistics Sub-task Resolved wujinhu   Actions
        30.
        AliyunOSS: improvements for copyFile/copyDirectory and logging Sub-task Resolved wujinhu   Actions
        31.
        AliyunOSS: Remove temporary files when upload small files to OSS Sub-task Resolved wujinhu   Actions
        32.
        AliyunOSS: support ListObjectsV2 Sub-task Resolved wujinhu

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        Actions

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            uncleGen Genmao Yu Assign to me
            uncleGen Genmao Yu

            Dates

              Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 10m
              10m

              Slack

                Issue deployment