Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12405

WAL accounting by Store

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.0, 2.0.0
    • 1.1.0, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog, so there are two problems:
      1. We record minSeqId both in HRegion and FSHLog, which is a duplication.
      2. There maybe holes in WAL accounting.
      For example, assume family A with sequence id 1 and 3, family B with seqId 2. If we flush family A, we can only record that WAL before sequence id 1 can be removed safely. If we do a replay at this point, sequence id 3 will also be replayed which is unnecessary.

      Attachments

        1. HBASE-12405_1.patch
          239 kB
          Duo Zhang
        2. HBASE-12405_2.patch
          234 kB
          Duo Zhang
        3. HBASE-12405_3.patch
          241 kB
          Duo Zhang
        4. HBASE-12405_4.patch
          233 kB
          Duo Zhang
        5. HBASE-12405_5.patch
          233 kB
          Duo Zhang
        6. HBASE-12405.patch
          240 kB
          Duo Zhang
        7. HBASE-12405-addendum.patch
          1 kB
          Duo Zhang

        Issue Links

          Activity

            People

              zhangduo Duo Zhang
              zhangduo Duo Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: