Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-9918

Erasure Coding: Sort located striped blocks based on decommissioned states

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      This jira is a follow-on work of HDFS-8786, where we do decommissioning of datanodes having striped blocks.

      Now, after decommissioning it requires to change the ordering of the storage list so that the decommissioned datanodes should only be last node in list.

      For example, assume we have a block group with storage list:-
      d0, d1, d2, d3, d4, d5, d6, d7, d8, d9
      mapping to indices
      0, 1, 2, 3, 4, 5, 6, 7, 8, 2

      Here the internal block b2 is duplicated, locating in d2 and d9. If d2 is a decommissioning node then should switch d2 and d9 in the storage list.

      Thanks jingzhao for the discussions

      Attachments

        1. HDFS-9918-001.patch
          25 kB
          Rakesh Radhakrishnan
        2. HDFS-9918-002.patch
          26 kB
          Rakesh Radhakrishnan
        3. HDFS-9918-003.patch
          27 kB
          Rakesh Radhakrishnan
        4. HDFS-9918-004.patch
          28 kB
          Rakesh Radhakrishnan
        5. HDFS-9918-005.patch
          28 kB
          Rakesh Radhakrishnan
        6. HDFS-9918-006.patch
          28 kB
          Rakesh Radhakrishnan
        7. HDFS-9918-007.patch
          27 kB
          Rakesh Radhakrishnan
        8. HDFS-9918-008.patch
          31 kB
          Rakesh Radhakrishnan
        9. HDFS-9918-009.patch
          29 kB
          Rakesh Radhakrishnan
        10. HDFS-9918-010.patch
          31 kB
          Rakesh Radhakrishnan
        11. HDFS-9918-011.patch
          31 kB
          Rakesh Radhakrishnan
        12. HDFS-9918-012.patch
          39 kB
          Rakesh Radhakrishnan
        13. HDFS-9918-013.patch
          40 kB
          Rakesh Radhakrishnan

        Activity

          People

            rakeshr Rakesh Radhakrishnan
            rakeshr Rakesh Radhakrishnan
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: