Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12405

WAL accounting by Store

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0, 2.0.0
    • Fix Version/s: 1.1.0, 2.0.0
    • Component/s: wal
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog, so there are two problems:
      1. We record minSeqId both in HRegion and FSHLog, which is a duplication.
      2. There maybe holes in WAL accounting.
      For example, assume family A with sequence id 1 and 3, family B with seqId 2. If we flush family A, we can only record that WAL before sequence id 1 can be removed safely. If we do a replay at this point, sequence id 3 will also be replayed which is unnecessary.

        Attachments

        1. HBASE-12405_1.patch
          239 kB
          Duo Zhang
        2. HBASE-12405_2.patch
          234 kB
          Duo Zhang
        3. HBASE-12405_3.patch
          241 kB
          Duo Zhang
        4. HBASE-12405_4.patch
          233 kB
          Duo Zhang
        5. HBASE-12405_5.patch
          233 kB
          Duo Zhang
        6. HBASE-12405.patch
          240 kB
          Duo Zhang
        7. HBASE-12405-addendum.patch
          1 kB
          Duo Zhang

          Issue Links

            Activity

              People

              • Assignee:
                zhangduo Duo Zhang
                Reporter:
                zhangduo Duo Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: