Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-2341

Upgrade to commons compress 1.14 when available

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.16
    • None
    • None

    Description

      For Tika 1.15, we added temporary copy/pastes of updated CompressorInputStreamFactory and ArchiveInputStreamFactory.

      There's now a static detect() method which should prevent OOMs while detecting some corrupt files.

      There's also now a memoryLimitInKb parameter that limits the amount of memory that can be allocated. This is can be used to protect against OOM for corrupt files that might appear to allege enormous block sizes.

      Many thanks to bodewig and the commons-compress community for their quick responses to PRs!

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. TIKA-2099 Tar files without magic bytes are sporadically detected as text

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. TIKA-2330 Prevent preventable OOM in CompressorInputStream

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              tallison Tim Allison
              tallison Tim Allison
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: