Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14281 Dynamometer Phase 2
  3. HDFS-14930

[Dynamometer] EC files become missing block groups

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      If there are ec files in fsimage and simulating it with Dynamometer, all of them become missing block groups.

      $ sudo -u hdfs hdfs fsck /tmp/ec_test_data
      ...
      Erasure Coded Block Groups:
       Total size:    52753424 B
       Total files:   140
       Total block groups (validated):        140 (avg. block group size 376810 B)
        ********************************
        UNRECOVERABLE BLOCK GROUPS:   140 (100.0 %)
        CORRUPT FILES:        140
        MISSING BLOCK GROUPS: 140
        MISSING SIZE:         52753424 B
        ********************************
       Minimally erasure-coded block groups:  0 (0.0 %)
       Over-erasure-coded block groups:       0 (0.0 %)
       Under-erasure-coded block groups:      0 (0.0 %)
       Unsatisfactory placement block groups: 0 (0.0 %)
       Average block group size:      0.0
       Missing block groups:          140
       Corrupt block groups:          0
       Missing internal blocks:       0
       Blocks queued for replication: 0
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tasanuma Takanobu Asanuma
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: