Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6685

Balancer should preserve storage type of replicas

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: balancer & mover
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When Balancer moves replicas to balance the cluster, it should always move replicas from a storage with any type to another storage with the same type, i.e. it preserves storage type of replicas. It does not make sense to move replicas to a different storage type.

      1. h6685_20140731.patch
        61 kB
        Tsz Wo Nicholas Sze
      2. h6685_20140730b.patch
        60 kB
        Tsz Wo Nicholas Sze
      3. h6685_20140730.patch
        60 kB
        Tsz Wo Nicholas Sze
      4. h6685_20140729.patch
        60 kB
        Tsz Wo Nicholas Sze
      5. h6685_20140728.patch
        59 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Arpit Agarwal made changes -
          Link This issue is duplicated by HDFS-4989 [ HDFS-4989 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue requires HDFS-6739 [ HDFS-6739 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is required by HDFS-6584 [ HDFS-6584 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.6.0 [ 12327181 ]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h6685_20140731.patch [ 12658909 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h6685_20140730b.patch [ 12658654 ]
          Tsz Wo Nicholas Sze made changes -
          Summary Archival Storage: Update Balancer to preserve storage type of replicas Balancer should preserve storage type of replicas
          Description In order to maintain storage policy requirement, Balancer always moves replicas from a storage with any type to another storage with the same type, i.e. it preserves storage type of replicas. In this way, Balancer does not require to know storage policy information. When Balancer moves replicas to balance the cluster, it should always move replicas from a storage with any type to another storage with the same type, i.e. it preserves storage type of replicas. It does not make sense to move replicas to a different storage type.
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Parent HDFS-6584 [ 12722899 ]
          Issue Type Sub-task [ 7 ] Improvement [ 4 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h6685_20140730.patch [ 12658583 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h6685_20140729.patch [ 12658336 ]
          Arpit Agarwal made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h6685_20140728.patch [ 12658154 ]
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Assignee Tsz Wo Nicholas Sze [ szetszwo ]
          Tsz Wo Nicholas Sze created issue -

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development