Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6701

Make seed optional in NetworkTopology#sortByDistance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.5.0
    • 2.6.0
    • namenode
    • None

    Description

      Currently seed in NetworkTopology#sortByDistance is set to the blockid which causes the RNG to generate same pseudo random order for each block. If no node local block location is present,this causes the same rack local replica to be hit for a particular block.
      It'll be good to make the seed optional, so that one could turn it off if they want block locations of a block to be randomized.

      Attachments

        1. HDFS-6701-v4-branch2.txt
          19 kB
          Ashwin Shankar
        2. HDFS-6701-v4.txt
          17 kB
          Ashwin Shankar
        3. HDFS-6701-v3-branch2.txt
          19 kB
          Ashwin Shankar
        4. HDFS-6701-v3.txt
          17 kB
          Ashwin Shankar
        5. HDFS-6701-v1.txt
          16 kB
          Ashwin Shankar

        Issue Links

          Activity

            People

              ashwinshankar77 Ashwin Shankar
              ashwinshankar77 Ashwin Shankar
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: