Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15255

Consider StorageType when DatanodeManager#sortLocatedBlock()

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.1, 3.4.0
    • 3.3.1, 3.4.0
    • hdfs
    • None
    • Reviewed

    Description

      When only one replica of a block is SDD, the others are HDD.
      When the client reads the data, the current logic is that it considers the distance between the client and the dn. I think it should also consider the StorageType of the replica. Priority to return fast StorageType node when the distance is same.

      Attachments

        1. HDFS-15255.010.patch
          21 kB
          Stephen O'Donnell
        2. HDFS-15255.009.patch
          19 kB
          Stephen O'Donnell
        3. HDFS-15255.008.patch
          19 kB
          Lisheng Sun
        4. HDFS-15255.007.patch
          19 kB
          Lisheng Sun
        5. HDFS-15255-findbugs-test.001.patch
          3 kB
          Lisheng Sun
        6. experiment-find-bugs.001.patch
          19 kB
          Stephen O'Donnell
        7. HDFS-15255.006.patch
          19 kB
          Lisheng Sun
        8. HDFS-15255.005.patch
          19 kB
          Lisheng Sun
        9. HDFS-15255.004.patch
          20 kB
          Lisheng Sun
        10. HDFS-15255.003.patch
          19 kB
          Lisheng Sun
        11. HDFS-15255.002.patch
          18 kB
          Lisheng Sun
        12. HDFS-15255.001.patch
          9 kB
          Lisheng Sun

        Issue Links

          Activity

            People

              leosun08 Lisheng Sun
              leosun08 Lisheng Sun
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: