Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha2
    • 3.0.0-alpha2
    • namenode
    • Reviewed
    • Fsck now reports whether a file is replicated and erasure-coded. If it is replicated, fsck reports replication factor of the file. If it is erasure coded, fsck reports the erasure coding policy of the file.

    Description

      Currently fsck reports corrupt EC files as follows: it does not distinguish erasure coded files versus replicated files. In addition, it would be nice to print out the ec policy of the corrupt EC file.

      /striped <dir>
      /striped/corrupted 393216 bytes, 1 block(s):
      /striped/corrupted: CORRUPT blockpool BP-1564681138-127.0.0.1-1475793860787 block blk_-9223372036854775792
      Under replicated BP-1564681138-127.0.0.1-1475793860787:blk_-9223372036854775792_1001. Target Replicas is 9 but found 5 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
      CORRUPT 1 blocks of total size 393216 B
      0. BP-1564681138-127.0.0.1-1475793860787:blk_-9223372036854775792_1001 len=393216 Live_repl=5 [DatanodeInfoWithStorage[127.0.0.1:62192,DS-81dcbc38-755e-446e-a028-71a79e4de6d9,DISK](CORRUPT), DatanodeInfoWithStorage[127.0.0.1:62180,DS-98fe193d-6342-4b2c-ad61-4586e2530b1e,DISK](CORRUPT), DatanodeInfoWithStorage[127.0.0.1:62167,DS-53031f88-0c63-4839-ab18-efea2f1bb063,DISK](CORRUPT), DatanodeInfoWithStorage[127.0.0.1:62162,DS-e8b418fd-165d-4d6f-886b-f75c21be096d,DISK](CORRUPT), DatanodeInfoWithStorage[127.0.0.1:62176,DS-03e51584-5b33-4bb6-89b5-f519cda57429,DISK](LIVE), DatanodeInfoWithStorage[127.0.0.1:62158,DS-ce9ca7b3-5b00-4351-8537-822eed532b46,DISK](LIVE), DatanodeInfoWithStorage[127.0.0.1:62184,DS-668c500e-eb3d-4d40-b900-814076d5e160,DISK](LIVE), DatanodeInfoWithStorage[127.0.0.1:62171,DS-763a3961-b214-4601-81c0-abdaecf539c4,DISK](LIVE), DatanodeInfoWithStorage[127.0.0.1:62188,DS-d4ea6399-bead-452e-8dd5-bc8c5ebd4f45,DISK](LIVE)]

      Attachments

        1. HDFS-10976.001.patch
          3 kB
          Wei-Chiu Chuang
        2. HDFS-10976.002.patch
          3 kB
          Wei-Chiu Chuang

        Activity

          People

            weichiu Wei-Chiu Chuang
            weichiu Wei-Chiu Chuang
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: