Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13811

Splitting WALs, we are filtering out too many edits -> DATALOSS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.1.0, 1.2.0, 2.0.0
    • 1.2.0, 1.1.1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      I've been running ITBLLs against branch-1 around HBASE-13616 (move of ServerShutdownHandler to pv2). I have come across an instance of dataloss. My patch for HBASE-13616 was in place so can only think it the cause (but cannot see how). When we split the logs, we are skipping legit edits. Digging.

      Attachments

        1. 13811.txt
          42 kB
          Michael Stack
        2. 13811.branch-1.txt
          42 kB
          Michael Stack
        3. HBASE-13811.testcase.patch
          7 kB
          Duo Zhang
        4. HBASE-13811-v1.testcase.patch
          7 kB
          Duo Zhang
        5. 13811.branch-1.txt
          87 kB
          Michael Stack
        6. 13811.v2.branch-1.txt
          85 kB
          Michael Stack
        7. 13811.v3.branch-1.txt
          90 kB
          Michael Stack
        8. 13811.v3.branch-1.txt
          90 kB
          Michael Stack
        9. 13811.v4.branch-1.txt
          826 kB
          Michael Stack
        10. 13811.v5.branch-1.txt
          91 kB
          Michael Stack
        11. 13811.v6.branch-1.txt
          91 kB
          Michael Stack
        12. 13811.v6.branch-1.txt
          91 kB
          Michael Stack
        13. 13811.v7.branch-1.txt
          94 kB
          Michael Stack
        14. startCacheFlush.diff
          6 kB
          Duo Zhang
        15. 13811.v8.branch-1.txt
          105 kB
          Michael Stack
        16. 13811.v9.branch-1.txt
          107 kB
          Michael Stack
        17. HBASE-13811-branch-1.1.patch
          23 kB
          Duo Zhang
        18. 13811.addendum.txt
          0.9 kB
          Michael Stack

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-13853 ITBLL improvements after HBASE-13811

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: