HBase
  1. HBase
  2. HBASE-10447

Memstore flusher scans storefiles also when the scanner heap gets reset

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.98.0, 0.99.0
    • Fix Version/s: 0.98.0, 0.99.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      See the mail thread
      http://osdir.com/ml/general/2014-01/msg61294.html

      In case of flush we create a memstore flusher which in turn creates a StoreScanner backed by a Single ton MemstoreScanner.

      But this scanner also registers for any updates in the reader in the HStore. Is this needed?
      If this happens then any update on the reader may nullify the current heap and the entire Scanner Stack is reset, but this time with the other scanners for all the files that satisfies the last top key. So the flush that happens on the memstore holds the storefile scanners also in the heap that was recreated but originally the intention was to create a scanner on the memstore alone.

      1. HBASE-10447_trunk.patch
        14 kB
        ramkrishna.s.vasudevan
      2. HBASE-10447_trunk_1.patch
        0.7 kB
        ramkrishna.s.vasudevan
      3. HBASE-10447_0.98.patch
        14 kB
        ramkrishna.s.vasudevan

        Issue Links

          Activity

          Enis Soztutar made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          ramkrishna.s.vasudevan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          ramkrishna.s.vasudevan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          ramkrishna.s.vasudevan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Affects Version/s 0.96.1.1 [ 12325753 ]
          Fix Version/s 0.96.2 [ 12325658 ]
          ramkrishna.s.vasudevan made changes -
          Attachment HBASE-10447_trunk_1.patch [ 12626849 ]
          ramkrishna.s.vasudevan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          ramkrishna.s.vasudevan made changes -
          Attachment HBASE-10447_trunk.patch [ 12626599 ]
          ramkrishna.s.vasudevan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Andrew Purtell made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          ramkrishna.s.vasudevan made changes -
          Attachment HBASE-10447_0.98.patch [ 12626475 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.17 [ 12325845 ]
          Lars Hofhansl made changes -
          Link This issue is related to HBASE-4241 [ HBASE-4241 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.96.2 [ 12325658 ]
          Fix Version/s 0.94.17 [ 12325845 ]
          Andrew Purtell made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          Fix Version/s 0.99.0 [ 12325675 ]
          Priority Critical [ 2 ] Blocker [ 1 ]
          ramkrishna.s.vasudevan made changes -
          Field Original Value New Value
          Priority Major [ 3 ] Critical [ 2 ]
          ramkrishna.s.vasudevan created issue -

            People

            • Assignee:
              ramkrishna.s.vasudevan
              Reporter:
              ramkrishna.s.vasudevan
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development