[HDFS-7821] After rolling upgrade total files and directories displayed on UI does not match with actual value.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: J.Andreina
• Reporter: J.Andreina
• Created: 23/Feb/15 08:52
• Updated: 23/Feb/15 08:52

Description

Non Ha Cluster with one DN.
dfs.blockreport.intervalMsec =120000
dfs.datanode.directoryscan.interval = 120

Steps to Reproduce:
===================

Step 1: Write 11 files to HDFS.
Step 2: Prepare rolling upgrade using "hdfs dfsadmin -rollingUpgrade prepare"
Step 3: Shutdown SNN and NN . Start NN with the "hdfs namenode -rollingUpgrade started" option.
Step 4: Executed "hdfs dfsadmin -shutdownDatanode <DATANODE_HOST:IPC_PORT> upgrade" and restarted Datanode
Step 5: Write 3 files to hdfs ( block id assigned are : blk_1073741831_1007, blk_1073741832_1008,blk_1073741833_1009 )
Step 6: Shutdown both NN and DN
Step 7: Start NNs with the "hdfs namenode -rollingUpgrade rollback" option.
Start DNs with the "-rollback" option.
Step 8: Write 3 files to hdfs.

Issue:
=======
On UI Total files and directories shown is 3 ( while the count is 14 )

Observations:
=============

1. fsck report shows 14.

Status: HEALTHY
 Total size:    37944 B
 Total dirs:    7
 Total files:   7
 Total symlinks:                0
 Total blocks (validated):      6 (avg. block size 6324 B)
 Minimally replicated blocks:   6 (100.0 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       6 (100.0 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    3
 Average block replication:     1.0
 Corrupt blocks:                0
 Missing replicas:              12 (66.666664 %)
 Number of data-nodes:          1
 Number of racks:               1
FSCK ended at Mon Feb 23 16:38:38 CST 2015 in 6 milliseconds

2. Afer restart of Namenode , UI gets updated with the actual count .