Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13811

Splitting WALs, we are filtering out too many edits -> DATALOSS

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.1.0, 1.2.0, 2.0.0
    • 1.2.0, 1.1.1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      I've been running ITBLLs against branch-1 around HBASE-13616 (move of ServerShutdownHandler to pv2). I have come across an instance of dataloss. My patch for HBASE-13616 was in place so can only think it the cause (but cannot see how). When we split the logs, we are skipping legit edits. Digging.

      Attachments

        1. 13811.txt
          42 kB
          Michael Stack
        2. 13811.branch-1.txt
          42 kB
          Michael Stack
        3. HBASE-13811.testcase.patch
          7 kB
          Duo Zhang
        4. HBASE-13811-v1.testcase.patch
          7 kB
          Duo Zhang
        5. 13811.branch-1.txt
          87 kB
          Michael Stack
        6. 13811.v2.branch-1.txt
          85 kB
          Michael Stack
        7. 13811.v3.branch-1.txt
          90 kB
          Michael Stack
        8. 13811.v3.branch-1.txt
          90 kB
          Michael Stack
        9. 13811.v4.branch-1.txt
          826 kB
          Michael Stack
        10. 13811.v5.branch-1.txt
          91 kB
          Michael Stack
        11. 13811.v6.branch-1.txt
          91 kB
          Michael Stack
        12. 13811.v6.branch-1.txt
          91 kB
          Michael Stack
        13. 13811.v7.branch-1.txt
          94 kB
          Michael Stack
        14. startCacheFlush.diff
          6 kB
          Duo Zhang
        15. 13811.v8.branch-1.txt
          105 kB
          Michael Stack
        16. 13811.v9.branch-1.txt
          107 kB
          Michael Stack
        17. HBASE-13811-branch-1.1.patch
          23 kB
          Duo Zhang
        18. 13811.addendum.txt
          0.9 kB
          Michael Stack

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stack Michael Stack
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment