Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16509

Add option to LoadIncrementalHFiles which allows skipping unmatched column families

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None
    • Reviewed

    Description

      During my work on HBASE-15449, there came the need for LoadIncrementalHFiles not to bail out on unmatched column families.

      The use case is like this:

      • table has two column families, A and B
      • full backup is taken on this table
      • column family B is dropped
      • more data is written to the table
      • incremental backup is performed on the table
      • user performs incremental restore using the latest backup

      Since column family B is gone, LoadIncrementalHFiles would fail with IOException for family mismatch.

      This issue is to add an option to LoadIncrementalHFiles so that bulk load can load hfiles for the existing column families.

      Attachments

        1. 16509.v5.txt
          8 kB
          Ted Yu
        2. 16509.v4.txt
          7 kB
          Ted Yu
        3. 16509.v3.txt
          7 kB
          Ted Yu
        4. 16509.v3.txt
          7 kB
          Ted Yu
        5. 16509.v2.txt
          7 kB
          Ted Yu
        6. 16509.v1.txt
          6 kB
          Ted Yu

        Issue Links

          Activity

            People

              yuzhihong@gmail.com Ted Yu
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: