[HBASE-208] HADOOP-1093 adds INFO-level logging of stacktrace java.lang.Exception... ZlibFactory.getZlibCompressor(ZlibFactory.java:81)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Michael Stack
• Created: 19/Jun/07 23:25
• Updated: 04/Feb/08 21:41
• Resolved: 20/Jun/07 23:31

Description

This change:

+ 52. HADOOP-1193. Pool allocation of compression codecs. This
+ eliminates a memory leak that could cause OutOfMemoryException,
+ and also substantially improves performance.
+ (Arun C Murthy via cutting)

Added this to logs:

07/06/19 12:18:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
07/06/19 12:18:58 INFO zlib.ZlibFactory: Creating a new ZlibCompressor
java.lang.Exception
	at org.apache.hadoop.io.compress.zlib.ZlibFactory.getZlibCompressor(ZlibFactory.java:81)
	at org.apache.hadoop.io.compress.DefaultCodec.createCompressor(DefaultCodec.java:59)
	at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:740)
	at org.apache.hadoop.io.SequenceFile$RecordCompressWriter.<init>(SequenceFile.java:863)
	at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:136)
	at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:112)
	at org.apache.hadoop.hbase.HLog.rollWriter(HLog.java:227)
	at org.apache.hadoop.hbase.HLog.<init>(HLog.java:172)
	at org.apache.hadoop.hbase.AbstractMergeTestBase.createNewHRegion(AbstractMergeTestBase.java:137)
	at org.apache.hadoop.hbase.AbstractMergeTestBase.createAregion(AbstractMergeTestBase.java:104)
	at org.apache.hadoop.hbase.AbstractMergeTestBase.setUp(AbstractMergeTestBase.java:72)
	at junit.framework.TestCase.runBare(TestCase.java:125)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:118)
	at junit.framework.TestSuite.runTest(TestSuite.java:208)
	at junit.framework.TestSuite.run(TestSuite.java:203)
	at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:128)
	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196)

This seems to be culprit code:

  public static Compressor getZlibCompressor() {
    LOG.info("Creating a new ZlibCompressor");
    try {
      throw new Exception();
    } catch (Exception e) {
      e.printStackTrace();
    }
    return (nativeZlibLoaded) ? 
      new ZlibCompressor() : new BuiltInZlibDeflater(); 
  }