Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14350 Procedure V2 Phase 2: Assignment Manager
  3. HBASE-16554

Procedure V2 - Recover 'updated' part of WAL tracker if trailer is corrupted.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None

    Description

      If the last wal was closed cleanly, the global tracker will be the last wal tracker (no rebuild needed)
      if the last wal does not have a tracker (corrupted/master-killed). on load() we will rebuild the global tracker.

      To compute quickly which files should be deleted, we also want the tracker of each file.
      if the wal was closed properly and has a tracker we are good, if not we need to rebuild the tracker for that file.
      each file tracker contains a bitmap about what is in the wal (the updated bitmap), which is easy to compute just by reading each entry of the wal.
      The 'deleted' bitmap keeps track of the "running procedures" up to that wal, however, it's not required by WAL cleaner, so we don't bother recovering it.

      Attachments

        1. HBASE-16554.master.002.patch
          19 kB
          Apekshit Sharma
        2. HBASE-16554.master.001.patch
          19 kB
          Apekshit Sharma
        3. tracker-rebuild.patch
          16 kB
          Apekshit Sharma

        Issue Links

          Activity

            People

              appy Apekshit Sharma
              appy Apekshit Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: