Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16492

Support HuaweiCloud Object Storage as a Hadoop Backend File System

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • fs
    • None
    • Reviewed
    • Hide
      Added support for HuaweiCloud OBS (https://www.huaweicloud.com/en-us/product/obs.html) to Hadoop file system, just like what we do before for S3, ADLS, OSS, etc. With simple configuration, Hadoop applications can read/write data from OBS without any code change.
      Show
      Added support for HuaweiCloud OBS ( https://www.huaweicloud.com/en-us/product/obs.html ) to Hadoop file system, just like what we do before for S3, ADLS, OSS, etc. With simple configuration, Hadoop applications can read/write data from OBS without any code change.

    Description

      Added support for HuaweiCloud OBS (https://www.huaweicloud.com/en-us/product/obs.html) to Hadoop file system, just like what we do before for S3, ADLS, OSS, etc. With simple configuration, Hadoop applications can read/write data from OBS without any code change.

      Attachments

        1. OBSA HuaweiCloud OBS Adapter for Hadoop Support.pdf
          75 kB
          zhongjun
        2. image-2020-11-21-18-51-51-981.png
          15 kB
          zhongjun
        3. HADOOP-16492.017.patch
          445 kB
          zhongjun
        4. HADOOP-16492.016.patch
          464 kB
          zhongjun
        5. HADOOP-16492.015.patch
          465 kB
          zhongjun
        6. HADOOP-16492.014.patch
          465 kB
          zhongjun
        7. HADOOP-16492.013.patch
          462 kB
          zhongjun
        8. HADOOP-16492.012.patch
          461 kB
          zhongjun
        9. HADOOP-16492.011.patch
          461 kB
          zhongjun
        10. HADOOP-16492.010.patch
          461 kB
          zhongjun
        11. HADOOP-16492.009.patch
          457 kB
          zhongjun
        12. HADOOP-16492.008.patch
          457 kB
          zhongjun
        13. HADOOP-16492.007.patch
          457 kB
          zhongjun
        14. HADOOP-16492.006.patch
          457 kB
          zhongjun
        15. HADOOP-16492.005.patch
          457 kB
          zhongjun
        16. HADOOP-16492.004.patch
          457 kB
          zhongjun
        17. HADOOP-16492.003.patch
          456 kB
          zhongjun
        18. HADOOP-16492.002.patch
          455 kB
          zhongjun
        19. HADOOP-16492.001.patch
          455 kB
          zhongjun
        20. Difference Between OBSA and S3A.pdf
          655 kB
          zhongjun

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-17593 hadoop-huaweicloud and hadoop-cloud-storage to remove log4j as transitive dependency

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-17574 Build failure on trunk

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-17889 OBSFileSystem should support Snapshot operations

          • Major - Major loss of function.
          • Open

          Activity

            People

              Rigenyi lixianwei
              zhongjun zhongjun
              Votes:
              4 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: