Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23157

WAL unflushed seqId tracking may wrong when Durability.ASYNC_WAL is used

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.2.1
    • Fix Version/s: None
    • Component/s: regionserver, wal
    • Labels:
      None

      Description

      Durability.ASYNC_WAL do not wait wal sync and commit mvcc ahead. So when region start flush may get a large flushedSeqId and later wal process buffer entry and put a small unflushedSequenceIds for this region again.

        Attachments

        1. HBASE-23157-master-v1.patch
          5 kB
          Lijin Bin
        2. TestMaxFlushedSeqId.patch
          14 kB
          Lijin Bin
        3. HBASE-23157-UT.patch
          12 kB
          Duo Zhang

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-22539 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us"

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16721 Concurrency issue in WAL unflushed seqId tracking

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #739

          Web Link GitHub Pull Request #762

            Activity

              People

              • Assignee:
                binlijin Lijin Bin
                Reporter:
                binlijin Lijin Bin
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated: