Uploaded image for project: 'Comdev GSOC'
  1. Comdev GSOC
  2. GSOC-272

Apache OpenDAL: Ofs via CloudFilter Project

    XMLWordPrintableJSON

Details

    Description

      Apache OpenDAL Ofs via CloudFilter Project Proposal

      Contributor information

      • • Name: Feihan Huang
      • • Email: ho229v3666@gmail.com[1]
      • • GitHub: https://github.com/ho-229
      • • Location: Tianjin, China (GMT+8:00)

      Project information

      • • Name: OpenDAL Ofs via CloudFilter
      • • Related Issues: https://github.com/apache/opendal/issues/4130
      • • Project Mentors: Xuanwo xuanwo@apache.org[2] Jun Ouyang junouyang@apache.org[3]
      • • Project Community: Apache OpenDAL
      • • Project Size: Medium, ~175 hours

      Project abstract

      OpenDAL is a data access layer that allows users to easily and efficiently retrieve data from various storage services in a unified way. currently ofs can expose OpenDAL power in a fuse way that allow users to mount storage services locally.

      But fuse is only support Linux and some UNIX platforms which limits the usage scenarios of ofs. So we need to support other popular platform i.e. Windows to extend its usage scenarios.

      Windows has a number of options that allow user-mode applications to project hierarchical data from the backing data store into the file system, such as ProjFs and CloudFilter. Considering ofs are majorly used in cloud storage, we need to support CloudFilter as well.

      Goals

      In scope

      • • fetch data
      • • cancel fetch data
      • • validate data
      • • fetch placeholders (directory entries)
      • • cancel fetch placeholders
      • • open, close, delete, rename

      Out scope

      • • dehydrate (deprecate local cache)

      Timeline

      Before April 30

      • • Familiarize CloudFilter and its APIs..
      • • Investigate existing CloudFilter Rust bindings, and get in touch with the bindings maintainer if needed.
      • • Determine specific goals to implement.

      May 1 - May 26

      • • Work closely with CloudFilter Rust bindings, make sure it can be used in ofs.

      May 27 - June 20

      • • Write the major implementation of ofs via CloudFilter.

      June 21 - June 30

      • • Test the implementation of ofs via CloudFilter.
      • • Update docs of ofs
      • • Prepare midterm evaluation with mentor.

      July 1 - July 19

      • • Complete tests and fix bugs.
      • • Prepare final evaluation with mentor.

      Links

      [1] ho229v3666@gmail.com: _ho229v3666@gmail.com_
      [2] xuanwo@apache.org: _xuanwo@apache.org_
      [3] junouyang@apache.org: _junouyang@apache.org_

      Attachments

        Activity

          People

            Unassigned Unassigned
            xuanwo Hao Ding
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: