Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-1784

Missing rows after medium intensity insert

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.0
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This bug was uncovered by Mathias in his mail "Issue on data load with 0.20.0-rc2". Basically, somehow, after a medium intensity insert a lot of rows goes missing. Easy way to reproduce : PE. Doing a PE scan or randomRead afterwards won't uncover anything since it doesn't bother about null rows. Simply do a count in the shell, easy to test (I changed my scanner caching in the shell to do it faster).

      I tested some light insertions with force flush/compact/split in the shell and it doesn't break.

        Attachments

        1. 1784.patch
          3 kB
          Michael Stack
        2. 1784-v2.patch
          8 kB
          Michael Stack
        3. DataLoad.java
          4 kB
          Mathias Herberts
        4. dbl-assignment-20090831
          115 kB
          Mathias Herberts
        5. double-assignment
          19 kB
          Mathias Herberts
        6. HBASE-1784.log
          57 kB
          Mathias Herberts
        7. HBASE-1784-StoreFileScanner-hack.patch
          2 kB
          Andrew Kyle Purtell
        8. META.log
          8 kB
          Mathias Herberts
        9. post-1784v2.log
          10 kB
          Mathias Herberts
        10. processSplitRegion-check-regionIsOpening.patch
          1 kB
          Mathias Herberts

          Activity

            People

            • Assignee:
              stack Michael Stack
              Reporter:
              jdcryans Jean-Daniel Cryans
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: