Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20530

Composition of backup directory containing namespace when restoring is different from the actual hfile location

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1
    • None
    • None
    • Reviewed
    • Hide
      There is a directory layout change (tables with default namespace now get additional level in directory structure of the WALPlayer output) for WALPlayer output in WAL - to- HFile conversion mode, but only when multiple tables are specified (this is case only for backup module). The other tools using WALPLayer are not affected (unless they use multiple tables mode introduced by B&R feature).
      Show
      There is a directory layout change (tables with default namespace now get additional level in directory structure of the WALPlayer output) for WALPlayer output in WAL - to- HFile conversion mode, but only when multiple tables are specified (this is case only for backup module). The other tools using WALPLayer are not affected (unless they use multiple tables mode introduced by B&R feature).

    Description

      Here is partial listing of output from incremental backup:

      5306 2018-05-04 02:38 hdfs://mycluster/user/hbase/backup_loc/backup_1525401467793/table_almphxih4u/cf1/5648501da7194783947bbf07b172f07e
      

      When restoring, here is what HBackupFileSystem.getTableBackupDir returns:

      fileBackupDir=hdfs://mycluster/user/hbase/backup_loc/backup_1525401467793/default/table_almphxih4u
      

      You can see that namespace gets in the way, leading to inability of finding the proper hfile.

      Attachments

        1. HBASE-20530-v1.patch
          5 kB
          Vladimir Rodionov
        2. HBASE-20530-v2.patch
          7 kB
          Vladimir Rodionov
        3. HBASE-20530-v3.patch
          7 kB
          Vladimir Rodionov
        4. 20530-v3.patch
          7 kB
          Ted Yu

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vrodionov Vladimir Rodionov
            yuzhihong@gmail.com Ted Yu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment