Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20530

Composition of backup directory containing namespace when restoring is different from the actual hfile location

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1
    • None
    • None
    • Reviewed
    • Hide
      There is a directory layout change (tables with default namespace now get additional level in directory structure of the WALPlayer output) for WALPlayer output in WAL - to- HFile conversion mode, but only when multiple tables are specified (this is case only for backup module). The other tools using WALPLayer are not affected (unless they use multiple tables mode introduced by B&R feature).
      Show
      There is a directory layout change (tables with default namespace now get additional level in directory structure of the WALPlayer output) for WALPlayer output in WAL - to- HFile conversion mode, but only when multiple tables are specified (this is case only for backup module). The other tools using WALPLayer are not affected (unless they use multiple tables mode introduced by B&R feature).

    Description

      Here is partial listing of output from incremental backup:

      5306 2018-05-04 02:38 hdfs://mycluster/user/hbase/backup_loc/backup_1525401467793/table_almphxih4u/cf1/5648501da7194783947bbf07b172f07e
      

      When restoring, here is what HBackupFileSystem.getTableBackupDir returns:

      fileBackupDir=hdfs://mycluster/user/hbase/backup_loc/backup_1525401467793/default/table_almphxih4u
      

      You can see that namespace gets in the way, leading to inability of finding the proper hfile.

      Attachments

        1. HBASE-20530-v3.patch
          7 kB
          Vladimir Rodionov
        2. HBASE-20530-v2.patch
          7 kB
          Vladimir Rodionov
        3. HBASE-20530-v1.patch
          5 kB
          Vladimir Rodionov
        4. 20530-v3.patch
          7 kB
          Ted Yu

        Issue Links

          Activity

            People

              vrodionov Vladimir Rodionov
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: