Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      Hitchhiker is a new erasure coding algorithm developed as a research project at UC Berkeley. It has been shown to reduce network traffic and disk I/O by 25%-45% during data reconstruction while retaining the same storage capacity and failure tolerance capability as RS codes. This JIRA aims to introduce Hitchhiker to the HDFS-EC framework, as one of the pluggable codec algorithms.

      The existing implementation is based on HDFS-RAID.

      Attachments

        1. HDFS-7715-hhxor-encoder.patch
          23 kB
          jack liuquan
        2. HDFS-7715-hhxor-decoder.patch
          18 kB
          jack liuquan
        3. 7715-hitchhikerXOR-v2.patch
          26 kB
          jack liuquan
        4. 7715-hitchhikerXOR-v2-testcode.patch
          8 kB
          jack liuquan
        5. HADOOP-11828-hitchhikerXOR-V3.patch
          46 kB
          jack liuquan
        6. HADOOP-11828-hitchhikerXOR-V4.patch
          44 kB
          jack liuquan
        7. HADOOP-11828-hitchhikerXOR-V5.patch
          39 kB
          jack liuquan
        8. HADOOP-11828-hitchhikerXOR-V6.patch
          41 kB
          jack liuquan
        9. HADOOP-11828-hitchhikerXOR-V7.patch
          46 kB
          jack liuquan
        10. HADOOP-11828-v8.patch
          47 kB
          Zhe Zhang

        Activity

          People

            jack_liuquan jack liuquan
            zhz Zhe Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: