Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16899

Update HdfsDesign.md to reduce ambiguity

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0, 3.2.2
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      A proposed update to https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md in the section "Replica Placement: The First Baby Steps" 4th paragraph, 2nd last line.

      The sentence is leading to ambiguity of reader.

      Considering the statement segmented in 3 parts by the commas:

      1. the first part talks about "one thirds of replicas";
      2. the second part talks about "two thirds of replicas"
      3. the third part talking about "the other third" is leading to ambiguity when one thirds and two thirds have already accounted for the whole.

      Proposed solution:

      Getting rid of the third part or rephrasing entire sentence to capture the overall essence of the sentence.

      In other words, replacing 

      One third of replicas are on one node, two thirds of replicas are on one rack, and the other third are evenly distributed across the remaining racks.

      with

      One third of replicas are on one node, two thirds of replicas are on one rack.

      Two replicas are on different nodes of one rack and the remaining replica is on a node of one of the other racks.

      In addition to this, found 2 more sentences in same paragraph that will be corrected.

      1.

      However, it does reduce the aggregate network bandwidth used when reading data since a block is placed in only two unique racks rather than three.

      will replace: does reduce -> does not reduce

      2. 

      With this policy, the replicas of a file do not evenly distribute across the racks.

      will replace: replicas of a file -> replicas of a block 

      Please suggest if any additional meaning is getting lost with this replacement.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                invincible-akshay Akshay Nehe
                Reporter:
                invincible-akshay Akshay Nehe
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: