Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23633

Find a way to handle the corrupt recovered hfiles

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha-1, 2.3.0
    • Fix Version/s: 3.0.0-alpha-1, 2.3.0
    • Component/s: MTTR, wal
    • Labels:
      None

      Description

      Copy the comment from PR review.

       

      If the file is a corrupt HFile, an exception will be thrown here, which will cause the region to fail to open.
      Maybe we can add a new parameter to control whether to skip the exception, similar to recover edits which has a parameter "hbase.hregion.edits.replay.skip.errors";

       

      Regions that can't be opened because of detached References or corrupt hfiles are a fact-of-life. We need work on this issue. This will be a new variant on the problem – i.e. bad recovered hfiles.

      On adding a config to ignore bad files and just open, thats a bit dangerous as per @infraio .... as it could mean silent data loss.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              pankajkumar Pankaj Kumar
              Reporter:
              zghao Guanghao Zhang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment