[HBASE-15496] Throw RowTooBigException only for user scan/get

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.4.0, 2.0.0
• Component/s: Scanners
• Hadoop Flags: Reviewed
• Assignee: Guanghao Zhang
• Reporter: Guanghao Zhang
• Created: 21/Mar/16 12:10
• Updated: 23/Jun/16 06:19
• Resolved: 26/Mar/16 11:02

Description

When config hbase.table.max.rowsize, RowTooBigException may be thrown by StoreScanner. But region flush/compact should catch it or throw it only for user scan.

Exceptions:
org.apache.hadoop.hbase.regionserver.RowTooBigException: Max row size allowed: 10485760, but row is bigger than that
at org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:355)
at org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:276)
at org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:238)
at org.apache.hadoop.hbase.regionserver.compactions.Compactor.createScanner(Compactor.java:403)
at org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:95)
at org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:131)
at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1211)
at org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1952)
at org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1774)

or

org.apache.hadoop.hbase.regionserver.RowTooBigException: Max row size allowed: 10485760, but the row is bigger than that.
at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:576)
at org.apache.hadoop.hbase.regionserver.StoreFlusher.performFlush(StoreFlusher.java:132)
at org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher.flushSnapshot(DefaultStoreFlusher.java:75)
at org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:880)
at org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2155)
at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2454)
at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2193)
at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2162)
at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:2053)
at org.apache.hadoop.hbase.regionserver.HRegion.flush(HRegion.java:1979)
at org.apache.hadoop.hbase.regionserver.TestRowTooBig.testScannersSeekOnFewLargeCells(TestRowTooBig.java:101)