Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-684

Use HAR filesystem to merge parity files

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • contrib/raid
    • None

    Description

      The HDFS raid implementation (HDFS-503) creates a parity file for every file that is RAIDed. This puts additional burden on the memory requirements of the namenode. It will be nice if the parity files are combined together using the HadoopArchive (har) format.

      Attachments

        1. HDFS-684.0.patch
          7 kB
          Rodrigo Schmidt
        2. HDFS-684.1.patch
          25 kB
          Rodrigo Schmidt

        Activity

          People

            rschmidt Rodrigo Schmidt
            dhruba Dhruba Borthakur
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: