Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16012

Major compaction can't work due to obsolete scanner read point in RegionServer

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      When new RegionScanner, it will add a scanner read point in scannerReadPoints. But if we got a exception after add read point, the read point will keep in regions server and the delete after this mvcc number will never be compacted.

      Our hbase version is base 0.94. If it throws other exception when initialize RegionScanner, the master branch has this bug, too.

      ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: Failed openScanner java.io.IOException: Could not seek StoreFileScanner
      at org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:160)
      at org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:268)
      at org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:168)
      at org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:2232)
      at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.<init>(HRegion.java:4026)
      at org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:1895)
      at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1879)
      at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1854)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.internalOpenScanner(HRegionServer.java:3032)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:2995)
      at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.hbase.ipc.SecureRpcEngine$Server.call(SecureRpcEngine.java:338)
      at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1595)
      Caused by: org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call openScanner, since caller disconnected
      at org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:475)
      at org.apache.hadoop.hbase.io.hfile.HFileBlock$AbstractFSReader.readAtOffset(HFileBlock.java:1443)
      at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderV2.readBlockDataInternal(HFileBlock.java:1902)
      at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderV2.readBlockData(HFileBlock.java:1766)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:345)
      at org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:254)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:499)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:520)
      at org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:235)
      at org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:148)
      ... 14 more

        Attachments

        1. HBASE-16012.patch
          2 kB
          Guanghao Zhang
        2. HBASE-16012-0.98-v5.patch
          4 kB
          Guanghao Zhang
        3. HBASE-16012-branch-1-v5.patch
          4 kB
          Guanghao Zhang
        4. HBASE-16012-v1.patch
          4 kB
          Guanghao Zhang
        5. HBASE-16012-v2.patch
          5 kB
          Guanghao Zhang
        6. HBASE-16012-v3.patch
          5 kB
          Guanghao Zhang
        7. HBASE-16012-v4.patch
          5 kB
          Guanghao Zhang
        8. HBASE-16012-v5.patch
          4 kB
          Guanghao Zhang

          Issue Links

            Activity

              People

              • Assignee:
                zghao Guanghao Zhang
                Reporter:
                zghao Guanghao Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: