Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2514

RegionServer should refuse to be assigned a region that use LZO when LZO isn't available

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.20.2, 0.20.3, 0.20.4, 0.20.5, 0.20.6, 0.89.20100621
    • Fix Version/s: 0.90.0
    • Component/s: regionserver
    • Labels:
      None

      Description

      If a RegionServer is assigned a region that uses LZO but the required libraries aren't installed on that RegionServer, the server will fail unexpectedly after throwing a java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec

      2010-05-04 16:57:27,258 FATAL org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog required. Forcing server shutdown
      org.apache.hadoop.hbase.DroppedSnapshotException: region: tsdb,,1273011287339
              at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:994)
              at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:887)
              at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:255)
              at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:142)
      Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
              at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:91)
              at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:196)
              at org.apache.hadoop.hbase.io.hfile.HFile$Writer.getCompressingStream(HFile.java:388)
              at org.apache.hadoop.hbase.io.hfile.HFile$Writer.newBlock(HFile.java:374)
              at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkBlockBoundary(HFile.java:345)
              at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:517)
              at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:482)
              at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:558)
              at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:522)
              at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:979)
              ... 3 more
      Caused by: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
              at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
              at java.security.AccessController.doPrivileged(Native Method)
              at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:315)
              at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:330)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:250)
              at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:87)
              ... 12 more
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ryanobjc ryan rawson
                Reporter:
                tsuna Benoit Sigoure
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: