Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14660

AssertionError found when using offheap BucketCache with assertion enabled

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      During perf verification of HBASE-14463, found offheap BucketCache not working with assertion enabled in hbase-env.sh:

      export HBASE_OPTS="-ea -XX:+HeapDumpOnOutOfMemoryError -XX:+UseConcMarkSweepGC"
      

      And the error when running PE tool is like:

      15/10/21 16:06:34 INFO client.AsyncProcess: #10, table=TestTable, attempt=10/21 failed=20ops, last exception: java.io.IOException: java.io.IOException
              at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2181)
              at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:106)
              at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
              at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
              at java.lang.Thread.run(Thread.java:744)
      Caused by: java.lang.AssertionError
              at org.apache.hadoop.hbase.OffheapKeyValue.<init>(OffheapKeyValue.java:52)
              at org.apache.hadoop.hbase.io.hfile.HFileReaderImpl$HFileScannerImpl$ShareableMemoryOffheapKeyValue.<init>(HFileReaderImpl.java:1003)
              at org.apache.hadoop.hbase.io.hfile.HFileReaderImpl$HFileScannerImpl.getCell(HFileReaderImpl.java:949)
              at org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseek(StoreFileScanner.java:201)
              at org.apache.hadoop.hbase.regionserver.NonLazyKeyValueScanner.doRealSeek(NonLazyKeyValueScanner.java:55)
              at org.apache.hadoop.hbase.regionserver.KeyValueHeap.generalizedSeek(KeyValueHeap.java:323)
              at org.apache.hadoop.hbase.regionserver.KeyValueHeap.requestSeek(KeyValueHeap.java:279)
              at org.apache.hadoop.hbase.regionserver.StoreScanner.reseek(StoreScanner.java:825)
              at org.apache.hadoop.hbase.regionserver.StoreScanner.seekAsDirection(StoreScanner.java:813)
              at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:641)
              at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
              at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:5649)
              at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:5795)
              at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5568)
              at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5544)
              at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5530)
              at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2044)
              at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:663)
              at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2156)
      

      ramkrishna.s.vasudevan and Anoop Sam John, mind to take a look?

        Attachments

        1. HBASE-14660_4.patch
          20 kB
          ramkrishna.s.vasudevan
        2. HBASE-14660_3.patch
          19 kB
          ramkrishna.s.vasudevan
        3. HBASE-14660_2.patch
          3 kB
          Michael Stack
        4. HBASE-14660_2.patch
          3 kB
          ramkrishna.s.vasudevan
        5. HBASE-14660_1.patch
          2 kB
          ramkrishna.s.vasudevan
        6. HBASE-14660.patch
          2 kB
          ramkrishna.s.vasudevan

          Activity

            People

            • Assignee:
              ram_krish ramkrishna.s.vasudevan
              Reporter:
              liyu Yu Li
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: