Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11161

Incorporate Baidu Yun BOS file system implementation

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None
    • Target Version/s:

      Description

      Baidu Yun ( https://cloud.baidu.com/ ) is one of top tier cloud computing provider. Baidu Yun BOS is widely used among China's cloud users, but currently it is not easy to access data laid on BOS storage from user's Hadoop/Spark application, because of no original support for BOS in Hadoop.

      This work aims to integrate Baidu Yun BOS with Hadoop. By simple configuration, Spark/Hadoop applications can read/write data from BOS without any code change. Narrowing the gap between user's APP and data storage, like what have been done for S3 and Aliyun OSS in Hadoop.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              zhangfaen Faen Zhang
            • Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 840h
                840h
                Remaining:
                Remaining Estimate - 840h
                840h
                Logged:
                Time Spent - Not Specified
                Not Specified