Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16955

Umbrella Jira for improving the Hadoop-cos support in Hadoop

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs/cos
    • Labels:
      None
    • Target Version/s:
    • Release Note:
      Hide
      bugfix:

      - resolve the dependency conflict;
      - fix the upload buffer returning failed when some exceptions occur;
      - fix the issue that the single file upload can not be retried;
      - fix the bug of checking if a file exists through listing the file frequently.

      features:
      - support SessionCredentialsProvider and InstanceCredentialsProvider, which
      - allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket;
      - support the server encryption based on SSE-COS and SSE-C;
      - support the HTTP proxy settings;
      - support the storage class settings;
      Show
      bugfix: - resolve the dependency conflict; - fix the upload buffer returning failed when some exceptions occur; - fix the issue that the single file upload can not be retried; - fix the bug of checking if a file exists through listing the file frequently. features: - support SessionCredentialsProvider and InstanceCredentialsProvider, which - allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; - support the server encryption based on SSE-COS and SSE-C; - support the HTTP proxy settings; - support the storage class settings;

      Description

      This Umbrella Jira focus on fixing some known bugs and adding some important features.

       

      bugfix:

      1. resolve the dependency conflict;
      2. fix the upload buffer returning failed when some exceptions occur;
      3. fix the issue that the single file upload can not be retried;
      4. fix the bug of checking if a file exists through listing the file frequently.

      features:

      1. support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket;
      2. support the server encryption  based on SSE-COS and SSE-C;
      3. support the HTTP proxy settings;
      4. support the storage class settings;
      5. support the CRC64 checksum.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                yuyang733 Yang Yu
                Reporter:
                yuyang733 Yang Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 48h
                  48h
                  Remaining:
                  Time Spent - 4h Remaining Estimate - 44h
                  44h
                  Logged:
                  Time Spent - 4h Remaining Estimate - 44h
                  4h