Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5603

Improve block placement performance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      ReplicationTargetChooser chooses targets by iteratively selecting random nodes first and then filtering good targets until the required number of targets are chosen. This code may require selecting random nodes multiple times, thus introducing multiple traversals of the given portion of the cluster map. This code can be improved by traversing the portion of the cluster map only once.

      Attachments

        1. blockPlace1.patch
          4 kB
          Hairong Kuang
        2. blockPlace.patch
          4 kB
          Hairong Kuang

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-5638 More improvement on block placement performance

          • Major - Major loss of function.
          • Closed

          Activity

            People

              hairong Hairong Kuang
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: