Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-25266

[hbase-operator-tools] Add a repair tool for moving stale regions dir not present in meta away from table dir

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      This adds a new tool under hbase-tools module, that allows for moving aways regions dirs existing under table's hdfs dir, but not in meta. This is useful in cases where the region is not present in meta, but still has data on hdfs, yet no holes in the table region chain is detected.

      On such cases, the existing HBCK2 addFsRegionsMissingInMeta command isn't ideal, as it would bring the region back in meta and cause overlaps.

      This tool performs the following actions:
      1) Identifies regions in hdfs but not in meta using HBCK2.reportTablesWithMissingRegionsInMeta;
      2) For each of these regions, sidelines the related dir to a temp folder;
      3) Bulkload hfiles from each sidelined region to the related table;

      Sidelined regions are never removed from temp folder. Operators should remove those manually, after they certified on data integrity.

        Attachments

          Activity

            People

            • Assignee:
              wchevreuil Wellington Chevreuil
              Reporter:
              wchevreuil Wellington Chevreuil

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment