Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-24942

MergeTableRegionsProcedure should not call clean merge region

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      In MergeTableRegionsProcedure, we will call CatalogJanitor.cleanMergeQualifier to test whether the regions we want to merge still have merge qualifier. If so we will skip merge.

      But the problem is that, in cleanMergeQualifier, we will call cleanMergeRegion, where we may schedule GCMultipleMergedRegionsProcedure to actually clean the merged regions.

      I think the intention here is to speed up the cleaning of merged region. CatalogJanitor, we have a alreadyRunning guard to prevent multiple scan at the same time, to prevent scheduling duplicated GCMultipleMergedRegionsProcedure for the same region. But if we call cleanMergeQualifier directly from MergeTableRegionsProcedure, we may schedule duplicated GCMultipleMergedRegionsProcedure as there is no guard to prevent CatalogJanitor to run at the same time.

      And there is also another problem that, even if you disable CatalogJanitor, which means you want to stop cleaning meta, a call from MergeTableRegionsProcedure could still clean the records in meta...

      So I think here we should just check the qualifiers. If there are merge qualifiers we just skip merging, without scheduling any procedures.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zhangduo Duo Zhang
                Reporter:
                zhangduo Duo Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: