[HADOOP-15196] Zlib decompression fails when file having trailing garbage

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.0
• Assignee: Brahma Reddy Battula
• Reporter: Brahma Reddy Battula
• Created: 31/Jan/18 04:37
• Updated: 14/Jul/21 15:53

Description

When file has trailing garbage gzip will ignore.

gzip -d 2018011309-js.rishenglipin.com.gz

gzip: 2018011309-js.rishenglipin.com.gz: decompression OK, trailing garbage ignored

 when we use same file and decompress,we got following.

2018-01-13 14:23:43,151 | WARN  | task-result-getter-3 | Lost task 0.0 in stage 345.0 (TID 5686, node-core-gyVYT, executor 3): java.io.IOException: unknown compression method

        at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.inflateBytesDirect(Native Method)

        at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.decompress(ZlibDecompressor.java:225)

        at org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:91)

        at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:85)