[IMPALA-2154] Fix decompressor to allow parsing gzips with multiple streams

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.0, Impala 2.1, Impala 2.2
• Fix Version/s: Impala 2.5.0
• Component/s: Backend
• Labels: correctness downgraded
• Target Version: Impala 2.5.0
• Assignee: Juan Yu
• Reporter: Bharath Vissapragada
• Created: 24/Jul/15 17:16
• Updated: 28/Feb/16 22:53
• Resolved: 28/Feb/16 22:53

Description

Currently we bailout as soon as we hit Z_STREAM_END. However gzip spec allows having multiple concatenated streams and we need to repeat inflate() again to parse rest of the data.

Issue Links

• relates to: IMPALA-1886 Impala doesn't support multi-stream bz2 compressed file