Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11625

Reading datablock throws "Invalid HFile block magic" and can not switch to hdfs checksum

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.94.21, 0.98.4, 0.98.5, 1.0.1.1, 1.0.3
    • 1.3.0, 1.2.2, 1.1.6, 2.0.0
    • HFile
    • None

    Description

      when using hbase checksum,call readBlockDataInternal() in hfileblock.java, it could happen file corruption but it only can switch to hdfs checksum inputstream till validateBlockChecksum(). If the datablock's header corrupted when b = new HFileBlock(),it throws the exception "Invalid HFile block magic" and the rpc call fail

      Attachments

        1. 2711de1fdf73419d9f8afc6a8b86ce64.gz
          4.30 MB
          Paul Fleetwood
        2. HBASE-11625.patch
          0.8 kB
          Pankaj Kumar
        3. correct-hfile
          1 kB
          Apekshit Sharma
        4. corrupted-header-hfile
          1 kB
          Apekshit Sharma
        5. HBASE-11625-master.patch
          16 kB
          Apekshit Sharma
        6. HBASE-11625-master-v2.patch
          18 kB
          Apekshit Sharma
        7. HBASE-11625-master-v3.patch
          18 kB
          Apekshit Sharma
        8. HBASE-11625-branch-1-v1.patch
          18 kB
          Apekshit Sharma
        9. HBASE-11625-branch-1.2-v1.patch
          27 kB
          Apekshit Sharma
        10. HBASE-11625-branch-1.2-v2.patch
          27 kB
          Apekshit Sharma
        11. HBASE-11625-branch-1.2-v3.patch
          27 kB
          Apekshit Sharma
        12. HBASE-11625-branch-1.2-v4.patch
          27 kB
          Apekshit Sharma
        13. HBASE-11625.branch-1.1.001.patch
          30 kB
          Apekshit Sharma

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-13783 Improve error message "Could not seek StoreFileScanner" to indicate that issue could be a bad disk

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Web Link Review Board

          Web Link Review Board (branch-1.1)

          Activity

            People

              appy Apekshit Sharma
              qian wang qian wang
              Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: