Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
0.20.1, 0.20.2, 0.20.3, 0.20.4, 0.20.5, 0.20.6, 0.89.20100621
-
None
Description
If a RegionServer is assigned a region that uses LZO but the required libraries aren't installed on that RegionServer, the server will fail unexpectedly after throwing a java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
2010-05-04 16:57:27,258 FATAL org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog required. Forcing server shutdown org.apache.hadoop.hbase.DroppedSnapshotException: region: tsdb,,1273011287339 at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:994) at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:887) at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:255) at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:142) Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:91) at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:196) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.getCompressingStream(HFile.java:388) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.newBlock(HFile.java:374) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkBlockBoundary(HFile.java:345) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:517) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:482) at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:558) at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:522) at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:979) ... 3 more Caused by: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec at java.net.URLClassLoader$1.run(URLClassLoader.java:200) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:188) at java.lang.ClassLoader.loadClass(ClassLoader.java:315) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:330) at java.lang.ClassLoader.loadClass(ClassLoader.java:250) at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:87) ... 12 more
Attachments
Issue Links
- is related to
-
HBASE-2681 Graceful fallback to NONE when the native compression algo is not found
- Closed
- relates to
-
HBASE-2681 Graceful fallback to NONE when the native compression algo is not found
- Closed