Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3256

HDFS considers blocks under-replicated if topology script is configured with only 1 rack

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.0-alpha, 0.23.7
    • Component/s: None
    • Labels:
      None

      Description

      HDFS treats the mere presence of a topology script being configured as evidence that there are multiple racks. If there is in fact only a single rack, the NN will try to place the blocks on at least two racks, and thus blocks will be considered to be under-replicated.

      1. HDFS-3256.patch
        8 kB
        Aaron T. Myers
      2. HDFS-3256.patch
        8 kB
        Aaron T. Myers
      3. HDFS-3256.patch
        8 kB
        Aaron T. Myers
      4. HDFS-3256.patch
        8 kB
        Aaron T. Myers
      5. HDFS-3256.patch
        8 kB
        Aaron T. Myers
      6. HDFS-3256.patch
        3 kB
        Aaron T. Myers

        Issue Links

          Activity

          Kihwal Lee made changes -
          Fix Version/s 0.23.7 [ 12323955 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HDFS-3267 [ HDFS-3267 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HDFS-3266 [ HDFS-3266 ]
          Aaron T. Myers made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.0.0 [ 12320353 ]
          Resolution Fixed [ 1 ]
          Aaron T. Myers made changes -
          Attachment HDFS-3256.patch [ 12522462 ]
          Aaron T. Myers made changes -
          Attachment HDFS-3256.patch [ 12522458 ]
          Aaron T. Myers made changes -
          Attachment HDFS-3256.patch [ 12522445 ]
          Aaron T. Myers made changes -
          Attachment HDFS-3256.patch [ 12522394 ]
          Todd Lipcon made changes -
          Link This issue relates to HDFS-15 [ HDFS-15 ]
          Aaron T. Myers made changes -
          Attachment HDFS-3256.patch [ 12522367 ]
          Aaron T. Myers made changes -
          Description HDFS treats the mere presence of a topology script being configured as of evidence that there are multiple racks. If there is in fact only a single rack, the NN will try to place the blocks on at least two racks, and thus blocks will be considered to be under-replicated. HDFS treats the mere presence of a topology script being configured as evidence that there are multiple racks. If there is in fact only a single rack, the NN will try to place the blocks on at least two racks, and thus blocks will be considered to be under-replicated.
          Aaron T. Myers made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Aaron T. Myers made changes -
          Field Original Value New Value
          Attachment HDFS-3256.patch [ 12522322 ]
          Aaron T. Myers created issue -

            People

            • Assignee:
              Aaron T. Myers
              Reporter:
              Aaron T. Myers
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development