[FLUME-1307] Improve unit test for concatenated gzip files

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Sinks+Sources
• Assignee: Unassigned
• Reporter: Mike Percy
• Created: 22/Jun/12 01:24
• Updated: 27/Mar/13 05:55

Description

Relates to FLUME-1301. We should make a better unit test for multi-member gzip files, which actually validates the correctness (or does better).

One potential way to do it is to check the last 8 bytes of the file for the little-endian CRC32 checksum and little-endian unsigned 32-bit length of the uncompressed content of the last member in a multi-member file.