[HBASE-25994] Active WAL tailing fails when WAL value compression is enabled

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha-1, 2.5.0
• Fix Version/s: 3.0.0-alpha-1, 2.5.0
• Hadoop Flags: Reviewed
• Assignee: Andrew Kyle Purtell
• Reporter: Andrew Kyle Purtell
• Created: 10/Jun/21 19:50
• Updated: 15/Jun/21 18:24
• Resolved: 15/Jun/21 00:16

Description

Depending on which compression codec is used, a short read of the compressed bytes can cause catastrophic errors that confuse the WAL reader. This problem can manifest when the reader is actively tailing the WAL for replication. The input stream's available() method sometimes lies so cannot be relied upon. To avoid these issues, when WAL value compression is enabled, ensure all bytes of the compressed value are read before submitting the payload to the decompressor.

Issue Links

• is related to: HBASE-25869 WAL value compression
• links to: GitHub Pull Request #3377