[TIKA-2330] Prevent preventable OOM in CompressorInputStream

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.15
• Assignee: Unassigned
• Reporter: Tim Allison
• Created: 19/Apr/17 20:33
• Updated: 26/Apr/17 15:21
• Resolved: 20/Apr/17 01:21

Description

On TIKA-1631, users noted that merely detecting an x-compress file could cause an OOM because we were instantiating the stream as part of detection.
On COMPRESS-382, lfcnassif noted that something similar happens with LZMA.

Let's work with the Compress project to:
1) add a static detect that doesn't instantiate the streams (COMPRESS-385)
2) allow a parameterizable limit on the amount of allocated space for x-compress (COMPRESS-386) and LZMA (COMPRESS-382)

Until we have a chance to make these changes in the compress project, let's temporarily copy/paste/update from Compress to fix these within Tika.

Issue Links

• is depended upon by: TIKA-1631 OutOfMemoryException in ZipContainerDetector
• relates to: TIKA-2341 Upgrade to commons compress 1.14 when available