Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2832 Enable support for heterogeneous storages in HDFS - DN as a collection of storages
  3. HDFS-4987

Namenode changes to track multiple storages

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Currently namenode track in BlockInfo, the corresponding DataNodeDescriptor. I propose changing this with new abstraction StorageDescriptor. This change will also make DatanodeDescriptor a collection of StroageDescriptors. This will allow given a block, identify its storage and also Datanode.

      Attachments

        1. h4987_20130828.patch
          63 kB
          Tsz-wo Sze
        2. h4987_20130827c.patch
          62 kB
          Tsz-wo Sze
        3. h4987_20130827b.patch
          62 kB
          Tsz-wo Sze
        4. h4987_20130827.patch
          62 kB
          Tsz-wo Sze
        5. h4987_20130822.patch
          38 kB
          Tsz-wo Sze

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HDFS-5154 Fix several tests failure after HDFS-4987

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue HDFS-5009 NameNode should expose storage information in the LocatedBlock

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-5134 NameNode improvements to per-storage block processing

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              szetszwo Tsz-wo Sze
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: