Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2832

Enable support for heterogeneous storages in HDFS - DN as a collection of storages

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.3.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Target Version/s:

      Description

      HDFS currently supports configuration where storages are a list of directories. Typically each of these directories correspond to a volume with its own file system. All these directories are homogeneous and therefore identified as a single storage at the namenode. I propose, change to the current model where Datanode * is a * storage, to Datanode * is a collection * of strorages.

        Attachments

        1. 20130813-HeterogeneousStorage.pdf
          80 kB
          Arpit Agarwal
        2. 20131125-HeterogeneousStorage.pdf
          80 kB
          Arpit Agarwal
        3. 20131125-HeterogeneousStorage-TestPlan.pdf
          44 kB
          Arpit Agarwal
        4. 20131202-HeterogeneousStorage-TestPlan.pdf
          44 kB
          Arpit Agarwal
        5. 20131203-HeterogeneousStorage-TestPlan.pdf
          44 kB
          Arpit Agarwal
        6. editsStored
          4 kB
          Arpit Agarwal
        7. editsStored
          5 kB
          Arpit Agarwal
        8. h2832_20131023.patch
          455 kB
          Tsz Wo Nicholas Sze
        9. h2832_20131023b.patch
          452 kB
          Tsz Wo Nicholas Sze
        10. h2832_20131025.patch
          456 kB
          Tsz Wo Nicholas Sze
        11. h2832_20131028.patch
          506 kB
          Arpit Agarwal
        12. h2832_20131028b.patch
          506 kB
          Junping Du
        13. h2832_20131029.patch
          505 kB
          Arpit Agarwal
        14. h2832_20131103.patch
          497 kB
          Tsz Wo Nicholas Sze
        15. h2832_20131104.patch
          500 kB
          Tsz Wo Nicholas Sze
        16. h2832_20131105.patch
          517 kB
          Arpit Agarwal
        17. H2832_20131107.patch
          518 kB
          Arpit Agarwal
        18. h2832_20131107b.patch
          519 kB
          Arpit Agarwal
        19. h2832_20131108.patch
          505 kB
          Tsz Wo Nicholas Sze
        20. h2832_20131110.patch
          541 kB
          Arpit Agarwal
        21. h2832_20131110b.patch
          564 kB
          Arpit Agarwal
        22. h2832_20131111.patch
          563 kB
          Arpit Agarwal
        23. h2832_20131112.patch
          563 kB
          Arpit Agarwal
        24. h2832_20131112b.patch
          564 kB
          Arpit Agarwal
        25. h2832_20131114.patch
          567 kB
          Arpit Agarwal
        26. h2832_20131118.patch
          569 kB
          Arpit Agarwal
        27. h2832_20131119.patch
          568 kB
          Arpit Agarwal
        28. h2832_20131119b.patch
          565 kB
          Arpit Agarwal
        29. h2832_20131121.patch
          564 kB
          Arpit Agarwal
        30. h2832_20131122.patch
          575 kB
          Arpit Agarwal
        31. h2832_20131122b.patch
          562 kB
          Tsz Wo Nicholas Sze
        32. h2832_20131123.patch
          568 kB
          Tsz Wo Nicholas Sze
        33. h2832_20131124.patch
          576 kB
          Arpit Agarwal
        34. h2832_20131202.patch
          576 kB
          Arpit Agarwal
        35. h2832_20131203.patch
          577 kB
          Arpit Agarwal
        36. h2832_20131210.patch
          578 kB
          Arpit Agarwal
        37. h2832_20131211.patch
          574 kB
          Arpit Agarwal
        38. h2832_20131211b.patch
          574 kB
          Arpit Agarwal
        39. h2832_branch-2_20131226.patch
          566 kB
          Arpit Agarwal
        40. h2832_branch-2_20140103.patch
          566 kB
          Arpit Agarwal

          Issue Links

            Activity

              People

              • Assignee:
                arpitagarwal Arpit Agarwal
                Reporter:
                sureshms Suresh Srinivas
              • Votes:
                0 Vote for this issue
                Watchers:
                91 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: