[HDFS-8610] if set several dirs which belongs to one disk in "dfs.datanode.data.dir", NN calculate capacity wrong

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.7.0
• Component/s: datanode
• Assignee: Ajith S
• Reporter: tongshiquan
• Created: 16/Jun/15 08:28
• Updated: 10/Jan/17 14:56

Description

In my machine, disk info as below:
/dev/sdc1 8.1T 2.0T 5.7T 27% /export2
/dev/sdd1 8.1T 2.0T 5.7T 27% /export3
/dev/sde1 8.1T 2.8T 5.0T 36% /export4

then set "dfs.datanode.data.dir" as below, each disk have 10 dirs:
/export2/BigData/hadoop/data/dn,/export2/BigData/hadoop/data/dn1,/export2/BigData/hadoop/data/dn2,/export2/BigData/hadoop/data/dn3,/export2/BigData/hadoop/data/dn4,/export2/BigData/hadoop/data/dn5,/export2/BigData/hadoop/data/dn6,/export2/BigData/hadoop/data/dn7,/export2/BigData/hadoop/data/dn8,/export2/BigData/hadoop/data/dn9,/export2/BigData/hadoop/data/dn10,/export3/BigData/hadoop/data/dn,/export3/BigData/hadoop/data/dn1,/export3/BigData/hadoop/data/dn2,/export3/BigData/hadoop/data/dn3,/export3/BigData/hadoop/data/dn4,/export3/BigData/hadoop/data/dn5,/export3/BigData/hadoop/data/dn6,/export3/BigData/hadoop/data/dn7,/export3/BigData/hadoop/data/dn8,/export3/BigData/hadoop/data/dn9,/export3/BigData/hadoop/data/dn10,/export4/BigData/hadoop/data/dn,/export4/BigData/hadoop/data/dn1,/export4/BigData/hadoop/data/dn2,/export4/BigData/hadoop/data/dn3,/export4/BigData/hadoop/data/dn4,/export4/BigData/hadoop/data/dn5,/export4/BigData/hadoop/data/dn6,/export4/BigData/hadoop/data/dn7,/export4/BigData/hadoop/data/dn8,/export4/BigData/hadoop/data/dn9,/export4/BigData/hadoop/data/dn10

then NN will think in this DN have 8.1T * 30 = 243 TB, but actually it only have 24.3TB

Issue Links

• is duplicated by: HDFS-11191 Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.