Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14302

TableSnapshotInputFormat should not create back references when restoring snapshot

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.0.2, 1.2.0, 1.3.0, 1.1.3, 2.0.0
    • None
    • None
    • Reviewed

    Description

      TableSnapshotInputFormat restores the snapshot to a temporary directory that is outside the HBase's root directory so that it can read from the restored snapshot and also refer to hfiles in the actual root directory.

      In restoring the snapshot, we create new hfilelinks in the ephemeral location. Creating new hfile links also creates "back references" for GC. These back references are dangling since the restore location is outside the root dir, and requires a WRITE permission to the root dir (as opposed to just READ permission) to be able to run the MR-over-snapshot job.

      Attachments

        1. hbase-14302_v1.patch
          20 kB
          Enis Soztutar

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            enis Enis Soztutar
            enis Enis Soztutar
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment