Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11625

Reading datablock throws "Invalid HFile block magic" and can not switch to hdfs checksum

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.21, 0.98.4, 0.98.5, 1.0.1.1, 1.0.3
    • Fix Version/s: 1.3.0, 1.2.2, 1.1.6, 2.0.0
    • Component/s: HFile
    • Labels:
      None

      Description

      when using hbase checksum,call readBlockDataInternal() in hfileblock.java, it could happen file corruption but it only can switch to hdfs checksum inputstream till validateBlockChecksum(). If the datablock's header corrupted when b = new HFileBlock(),it throws the exception "Invalid HFile block magic" and the rpc call fail

        Attachments

        1. HBASE-11625.branch-1.1.001.patch
          30 kB
          Apekshit Sharma
        2. HBASE-11625-branch-1.2-v4.patch
          27 kB
          Apekshit Sharma
        3. HBASE-11625-branch-1.2-v3.patch
          27 kB
          Apekshit Sharma
        4. HBASE-11625-branch-1.2-v2.patch
          27 kB
          Apekshit Sharma
        5. HBASE-11625-branch-1.2-v1.patch
          27 kB
          Apekshit Sharma
        6. HBASE-11625-branch-1-v1.patch
          18 kB
          Apekshit Sharma
        7. HBASE-11625-master-v3.patch
          18 kB
          Apekshit Sharma
        8. HBASE-11625-master-v2.patch
          18 kB
          Apekshit Sharma
        9. HBASE-11625-master.patch
          16 kB
          Apekshit Sharma
        10. corrupted-header-hfile
          1 kB
          Apekshit Sharma
        11. correct-hfile
          1 kB
          Apekshit Sharma
        12. HBASE-11625.patch
          0.8 kB
          Pankaj Kumar
        13. 2711de1fdf73419d9f8afc6a8b86ce64.gz
          4.30 MB
          Paul Fleetwood

          Issue Links

            Activity

              People

              • Assignee:
                appy Apekshit Sharma
                Reporter:
                qian wang qian wang
              • Votes:
                0 Vote for this issue
                Watchers:
                22 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: