Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3119

Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.0-alpha, 0.23.7
    • Component/s: namenode
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      cluster setup:
      --------------

      1NN,2 DN,replication factor 2,block report interval 3sec ,block size-256MB

      step1: write a file "filewrite.txt" of size 90bytes with sync(not closed)
      step2: change the replication factor to 1 using the command: "./hdfs dfs -setrep 1 /filewrite.txt"
      step3: close the file

      • At the NN side the file "Decreasing replication from 2 to 1 for /filewrite.txt" , logs has occured but the overreplicated blocks are not deleted even after the block report is sent from DN
      • while listing the file in the console using "./hdfs dfs -ls " the replication factor for that file is mentioned as 1
      • In fsck report for that files displays that the file is replicated to 2 datanodes
      1. HDFS-3119.patch
        0.9 kB
        Ashish Singhi
      2. HDFS-3119-1.patch
        5 kB
        Ashish Singhi
      3. HDFS-3119-1.patch
        5 kB
        Uma Maheswara Rao G

        Activity

        Allen Wittenauer made changes -
        Affects Version/s 2.0.0-alpha [ 12320353 ]
        Affects Version/s 0.24.0 [ 12317653 ]
        Fix Version/s 0.24.0 [ 12317653 ]
        Kihwal Lee made changes -
        Fix Version/s 0.23.7 [ 12323955 ]
        Uma Maheswara Rao G made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 2.0.0 [ 12320353 ]
        Fix Version/s 0.23.2 [ 12319852 ]
        Resolution Fixed [ 1 ]
        Uma Maheswara Rao G made changes -
        Attachment HDFS-3119-1.patch [ 12521993 ]
        Ashish Singhi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Labels patch
        Ashish Singhi made changes -
        Attachment HDFS-3119-1.patch [ 12521139 ]
        Uma Maheswara Rao G made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Tsz Wo Nicholas Sze made changes -
        Assignee Ashish Singhi [ ashish singhi ]
        Brandon Li made changes -
        Assignee Brandon Li [ brandonli ]
        Ashish Singhi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ashish Singhi made changes -
        Attachment HDFS-3119.patch [ 12520392 ]
        Brandon Li made changes -
        Field Original Value New Value
        Assignee Brandon Li [ brandonli ]
        J.Andreina created issue -

          People

          • Assignee:
            Ashish Singhi
            Reporter:
            J.Andreina
          • Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development