Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1120

Make DataNode's block-to-device placement policy pluggable

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Make the DataNode's block-volume choosing policy pluggable.
    • Tags:
      datanode, volumes, policy

      Description

      As discussed on the mailing list, as the number of disk drives per server increases, it would be useful to allow the DataNode's policy for new block placement to grow in sophistication from the current round-robin strategy.

      1. HDFS-1120.r1.diff
        12 kB
        Harsh J
      2. HDFS-1120.r2.diff
        13 kB
        Harsh J
      3. HDFS-1120.r3.diff
        12 kB
        Harsh J
      4. HDFS-1120.r4.diff
        12 kB
        Harsh J

        Issue Links

          Activity

          Jeff Hammerbacher created issue -
          Jeff Hammerbacher made changes -
          Field Original Value New Value
          Link This issue is related to HDFS-1121 [ HDFS-1121 ]
          Allen Wittenauer made changes -
          Link This issue relates to HDFS-1312 [ HDFS-1312 ]
          Harsh J made changes -
          Assignee Harsh J Chouraria [ qwertymaniac ]
          Harsh J made changes -
          Attachment HDFS-1120.r1.diff [ 12474691 ]
          Harsh J made changes -
          Attachment HDFS-1120.r2.diff [ 12474692 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Make the DataNode's block-volume choosing policy pluggable.
          Fix Version/s 0.23.0 [ 12315571 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Attachment HDFS-1120.r3.diff [ 12474716 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tags datanode, volumes, policy
          Harsh J made changes -
          Attachment HDFS-1120.r4.diff [ 12474789 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Harsh J made changes -
          Link This issue is related to HDFS-1804 [ HDFS-1804 ]
          Harsh J made changes -
          Link This issue incorporates HDFS-1797 [ HDFS-1797 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-2887 [ HDFS-2887 ]

            People

            • Assignee:
              Harsh J
              Reporter:
              Jeff Hammerbacher
            • Votes:
              4 Vote for this issue
              Watchers:
              25 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development