Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6701

Make seed optional in NetworkTopology#sortByDistance

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.5.0
    • Fix Version/s: 2.6.0
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:

      Description

      Currently seed in NetworkTopology#sortByDistance is set to the blockid which causes the RNG to generate same pseudo random order for each block. If no node local block location is present,this causes the same rack local replica to be hit for a particular block.
      It'll be good to make the seed optional, so that one could turn it off if they want block locations of a block to be randomized.

        Attachments

        1. HDFS-6701-v1.txt
          16 kB
          Ashwin Shankar
        2. HDFS-6701-v3.txt
          17 kB
          Ashwin Shankar
        3. HDFS-6701-v3-branch2.txt
          19 kB
          Ashwin Shankar
        4. HDFS-6701-v4.txt
          17 kB
          Ashwin Shankar
        5. HDFS-6701-v4-branch2.txt
          19 kB
          Ashwin Shankar

          Issue Links

            Activity

              People

              • Assignee:
                ashwinshankar77 Ashwin Shankar
                Reporter:
                ashwinshankar77 Ashwin Shankar
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: