Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13811

Splitting WALs, we are filtering out too many edits -> DATALOSS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.1.0, 1.2.0, 2.0.0
    • 1.2.0, 1.1.1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      I've been running ITBLLs against branch-1 around HBASE-13616 (move of ServerShutdownHandler to pv2). I have come across an instance of dataloss. My patch for HBASE-13616 was in place so can only think it the cause (but cannot see how). When we split the logs, we are skipping legit edits. Digging.

      Attachments

        1. startCacheFlush.diff
          6 kB
          Duo Zhang
        2. HBASE-13811-v1.testcase.patch
          7 kB
          Duo Zhang
        3. HBASE-13811-branch-1.1.patch
          23 kB
          Duo Zhang
        4. HBASE-13811.testcase.patch
          7 kB
          Duo Zhang
        5. 13811.v9.branch-1.txt
          107 kB
          Michael Stack
        6. 13811.v8.branch-1.txt
          105 kB
          Michael Stack
        7. 13811.v7.branch-1.txt
          94 kB
          Michael Stack
        8. 13811.v6.branch-1.txt
          91 kB
          Michael Stack
        9. 13811.v6.branch-1.txt
          91 kB
          Michael Stack
        10. 13811.v5.branch-1.txt
          91 kB
          Michael Stack
        11. 13811.v4.branch-1.txt
          826 kB
          Michael Stack
        12. 13811.v3.branch-1.txt
          90 kB
          Michael Stack
        13. 13811.v3.branch-1.txt
          90 kB
          Michael Stack
        14. 13811.v2.branch-1.txt
          85 kB
          Michael Stack
        15. 13811.txt
          42 kB
          Michael Stack
        16. 13811.branch-1.txt
          42 kB
          Michael Stack
        17. 13811.branch-1.txt
          87 kB
          Michael Stack
        18. 13811.addendum.txt
          0.9 kB
          Michael Stack

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-13853 ITBLL improvements after HBASE-13811

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: