[HDFS-3119] Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.0.0-alpha, 0.23.7
• Component/s: namenode
• Labels: patch
• Hadoop Flags: Reviewed
• Assignee: Ashish Singhi
• Reporter: J.Andreina
• Created: 20/Mar/12 14:15
• Updated: 28/Sep/15 20:58
• Resolved: 09/Apr/12 19:32

Description

cluster setup:
--------------

1NN,2 DN,replication factor 2,block report interval 3sec ,block size-256MB

step1: write a file "filewrite.txt" of size 90bytes with sync(not closed)
step2: change the replication factor to 1 using the command: "./hdfs dfs -setrep 1 /filewrite.txt"
step3: close the file

• At the NN side the file "Decreasing replication from 2 to 1 for /filewrite.txt" , logs has occured but the overreplicated blocks are not deleted even after the block report is sent from DN

• while listing the file in the console using "./hdfs dfs -ls " the replication factor for that file is mentioned as 1

• In fsck report for that files displays that the file is replicated to 2 datanodes