[HDFS-14930] [Dynamometer] EC files become missing block groups

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Takanobu Asanuma
• Created: 24/Oct/19 11:31
• Updated: 24/Oct/19 11:31

Description

If there are ec files in fsimage and simulating it with Dynamometer, all of them become missing block groups.

$ sudo -u hdfs hdfs fsck /tmp/ec_test_data
...
Erasure Coded Block Groups:
 Total size:    52753424 B
 Total files:   140
 Total block groups (validated):        140 (avg. block group size 376810 B)
  ********************************
  UNRECOVERABLE BLOCK GROUPS:   140 (100.0 %)
  CORRUPT FILES:        140
  MISSING BLOCK GROUPS: 140
  MISSING SIZE:         52753424 B
  ********************************
 Minimally erasure-coded block groups:  0 (0.0 %)
 Over-erasure-coded block groups:       0 (0.0 %)
 Under-erasure-coded block groups:      0 (0.0 %)
 Unsatisfactory placement block groups: 0 (0.0 %)
 Average block group size:      0.0
 Missing block groups:          140
 Corrupt block groups:          0
 Missing internal blocks:       0
 Blocks queued for replication: 0