Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11625

Reading datablock throws "Invalid HFile block magic" and can not switch to hdfs checksum

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.21, 0.98.4, 0.98.5, 1.0.1.1, 1.0.3
    • Fix Version/s: 1.3.0, 1.2.2, 1.1.6, 2.0.0
    • Component/s: HFile
    • Labels:
      None

      Description

      when using hbase checksum,call readBlockDataInternal() in hfileblock.java, it could happen file corruption but it only can switch to hdfs checksum inputstream till validateBlockChecksum(). If the datablock's header corrupted when b = new HFileBlock(),it throws the exception "Invalid HFile block magic" and the rpc call fail

        Attachments

        1. 2711de1fdf73419d9f8afc6a8b86ce64.gz
          4.30 MB
          Paul Fleetwood
        2. HBASE-11625.patch
          0.8 kB
          Pankaj Kumar
        3. correct-hfile
          1 kB
          Apekshit Sharma
        4. corrupted-header-hfile
          1 kB
          Apekshit Sharma
        5. HBASE-11625-master.patch
          16 kB
          Apekshit Sharma
        6. HBASE-11625-master-v2.patch
          18 kB
          Apekshit Sharma
        7. HBASE-11625-master-v3.patch
          18 kB
          Apekshit Sharma
        8. HBASE-11625-branch-1-v1.patch
          18 kB
          Apekshit Sharma
        9. HBASE-11625-branch-1.2-v1.patch
          27 kB
          Apekshit Sharma
        10. HBASE-11625-branch-1.2-v2.patch
          27 kB
          Apekshit Sharma
        11. HBASE-11625-branch-1.2-v3.patch
          27 kB
          Apekshit Sharma
        12. HBASE-11625-branch-1.2-v4.patch
          27 kB
          Apekshit Sharma
        13. HBASE-11625.branch-1.1.001.patch
          30 kB
          Apekshit Sharma

        Issue Links

          Activity

            People

            • Assignee:
              appy Apekshit Sharma
              Reporter:
              qian wang qian wang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment