Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-684

Use HAR filesystem to merge parity files

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: contrib/raid
    • Labels:
      None

      Description

      The HDFS raid implementation (HDFS-503) creates a parity file for every file that is RAIDed. This puts additional burden on the memory requirements of the namenode. It will be nice if the parity files are combined together using the HadoopArchive (har) format.

        Attachments

        1. HDFS-684.0.patch
          7 kB
          Rodrigo Schmidt
        2. HDFS-684.1.patch
          25 kB
          Rodrigo Schmidt

          Activity

            People

            • Assignee:
              rschmidt Rodrigo Schmidt
              Reporter:
              dhruba Dhruba Borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: