Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6584 Support Archival Storage
  3. HDFS-6677

Archival Storage: Change INodeFile and FSImage to support storage policy

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Policy ID will be stored in INodeFile header with 4 bits which can support 16 different storage policies. The number of bits for replication will be reduced from 16 bits to 12 bits which is still able to support up to 4095 replicas. The number of bits for block size remains 48 bits. The memory usage of INodeFile remains unchanged.

      The storage policy IDs assigned to Hot, Warm and Cold policies are respectively 12, 8 and 4. These numbers are chosen with gaps so that future policies can be added in-between.

      We should make a corresponding change in FSImage.

        Attachments

        1. h6677_20140714.patch
          19 kB
          Tsz-wo Sze

          Issue Links

            Activity

              People

              • Assignee:
                szetszwo Tsz-wo Sze
                Reporter:
                szetszwo Tsz-wo Sze
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: