[HBASE-5387] Reuse compression streams in HFileBlock.Writer

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.94.0
• Fix Version/s: 0.94.0
• Hadoop Flags: Reviewed
• Assignee: Mikhail Gryzykhin
• Reporter: Mikhail Gryzykhin
• Created: 11/Feb/12 02:45
• Updated: 12/Oct/12 05:35
• Resolved: 13/Feb/12 22:24

Description

We need to to reuse compression streams in HFileBlock.Writer instead of allocating them every time. The motivation is that when using Java's built-in implementation of Gzip, we allocate a new GZIPOutputStream object and an associated native data structure every time we create a compression stream. The native data structure is only deallocated in the finalizer. This is one suspected cause of recent TestHFileBlock failures on Hadoop QA: https://builds.apache.org/job/HBase-TRUNK/2658/testReport/org.apache.hadoop.hbase.io.hfile/TestHFileBlock/testPreviousOffset_1_/.