Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13473

deleted cells come back alive after the stripe compaction

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 1.0.1, 1.1.0, 0.98.12, 2.0.0
    • 1.0.1, 1.1.0, 0.98.13, 2.0.0
    • Compaction
    • Reviewed
    • Patch

    Description

      during the STRIPE compaction,
      deletes(tombstones) are being dropped in 2 cases.
      1. Compaction including L0 (includeL0 == true)
      2. L0 has no files (canDropDeletesWithoutL0 == true)

      To drop delete marker and keep the consistency during compaction,
      All of HFiles in the stripe has to be selected, just like major compaction.
      otherwise, after the compaction only delete markers would be gone,
      and deleted cells (which is in the not-selected HFiles) are going to be alive again.
      In my cluster, there was no file on L0(canDropDeletesWithoutL0==true) and not all files are selected for compaction, so some of deleted rows have come back alive and appears when i get or scan after compactions.

      I made a patch about it.
      it checks if all files are selected before we set the majorRange of compaction request .

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            eomiks jeongmin kim Assign to me
            eomiks jeongmin kim
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment