Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23633

Find a way to handle the corrupt recovered hfiles

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha-1, 2.3.0
    • Fix Version/s: 3.0.0-alpha-1, 2.3.0
    • Component/s: MTTR, wal
    • Labels:
      None

      Description

      Copy the comment from PR review.

       

      If the file is a corrupt HFile, an exception will be thrown here, which will cause the region to fail to open.
      Maybe we can add a new parameter to control whether to skip the exception, similar to recover edits which has a parameter "hbase.hregion.edits.replay.skip.errors";

       

      Regions that can't be opened because of detached References or corrupt hfiles are a fact-of-life. We need work on this issue. This will be a new variant on the problem – i.e. bad recovered hfiles.

      On adding a config to ignore bad files and just open, thats a bit dangerous as per @infraio .... as it could mean silent data loss.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pankajkumar Pankaj Kumar
                Reporter:
                zghao Guanghao Zhang
              • Votes:
                1 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: