Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9036

In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      For example in below clusterMap

      Writer = "/d2/r4/n8" which does not have local node.
      Available nodes rack =

      {"/d2/r4/n7","/d1/r1/n1","/d1/r2/n3","/d2/r3/n6"}

      Current hierarchy in choosing node for first local storage replica is
      1. Choose local machine (Not available)
      2. Choose Local node group machine (Not available)
      3. choose random

      But instead of choosing random , should choose localrack node first(if fallbackToLocalRack is true, in example it is "/d2/r4/n7" ) else should go for radom node

      Attachments

        1. HDFS-9036.2.patch
          4 kB
          J.Andreina
        2. HDFS-9036.1.patch
          5 kB
          J.Andreina

        Activity

          People

            andreina J.Andreina
            andreina J.Andreina
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: