Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9036

In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For example in below clusterMap

      Writer = "/d2/r4/n8" which does not have local node.
      Available nodes rack =

      {"/d2/r4/n7","/d1/r1/n1","/d1/r2/n3","/d2/r3/n6"}

      Current hierarchy in choosing node for first local storage replica is
      1. Choose local machine (Not available)
      2. Choose Local node group machine (Not available)
      3. choose random

      But instead of choosing random , should choose localrack node first(if fallbackToLocalRack is true, in example it is "/d2/r4/n7" ) else should go for radom node

        Attachments

        1. HDFS-9036.2.patch
          4 kB
          J.Andreina
        2. HDFS-9036.1.patch
          5 kB
          J.Andreina

          Activity

            People

            • Assignee:
              andreina J.Andreina
              Reporter:
              andreina J.Andreina
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: