[HDFS-3295] Mismatch in number of bytes already moved and number of bytes being moved in balancer report

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.23.0
• Component/s: balancer & mover
• Target Version/s: 0.23.0
• Assignee: Ashish Singhi
• Reporter: J.Andreina
• Created: 18/Apr/12 10:56
• Updated: 25/Feb/14 02:25
• Resolved: 25/Feb/14 02:25

Description

Scenario:
Replication factor = 1,fs.defaultFS=hdfs://namenodeip:port,dfs.namenode.rpc-address=namenodeip:port.
step 1: started DN1.Pumped 4.67GB of data
step 2: started DN2.
step 3: issued the balancer cmd(./start-balancer.sh -threshold 1)

Totally 848.41 MB has been moved to 2DN and took 4 iterations to move the blocks to 2DN.

But in balancer output in all the iterations the number of bytes already moved is alway 0KB and there is mismatch in the Bytes being moved with the bytes left to move

Balancer output for 2nd Iteration
=================================

Time Stamp               Iteration#  Bytes Already Moved  Bytes Left To Move  Bytes Being Moved
Apr 18, 2012 12:41:20 PM          0                 0 KB           848.41 MB          151.18 MB
Apr 18, 2012 1:06:46 PM           1                 0 KB           646.02 MB          151.18 MB
Apr 18, 2012 1:10:28 PM           2                 0 KB           417.43 MB          151.18 MB
Apr 18, 2012 1:14:04 PM           3                 0 KB           223.84 MB          151.18 MB
Apr 18, 2012 1:18:10 PM           4                 0 KB            30.34 MB          151.18 MB

In the above balancer output

•Bytes already moved is 0KB
• In 3 rd iterarion Bytes left to move is 223.84 MB but Bytes being moved is 151.18 MB . So in next iteration the bytes left to move should be 223.84 MB - 151.18 MB