[TIKA-2496] TIKA crashes / runs out of memory on simple PDF

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.15
• Component/s: core

Environment

Linux, Java 8

• Assignee: Unassigned
• Reporter: chelambarasan
• Created: 08/Nov/17 17:24
• Updated: 29/Oct/19 15:52
• Resolved: 20/Dec/17 15:35

Description

We're using TIKA embedded in a webcrawler and today I've encountered a PDF that results in OutOfMemory errors while being processed by TIKA.

Tried with Xmx 5gb and pdf file sizes are approximately 50 mb.

Tika version: 1.15
Error as below:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at org.apache.pdfbox.io.ScratchFileBuffer.addPage(ScratchFileBuffer.java:132)
at org.apache.pdfbox.io.ScratchFileBuffer.ensureAvailableBytesInPage(ScratchFileBuffer.java:184)
at org.apache.pdfbox.io.ScratchFileBuffer.write(ScratchFileBuffer.java:236)
at org.apache.pdfbox.io.RandomAccessOutputStream.write(RandomAccessOutputStream.java:46)
at org.apache.pdfbox.cos.COSStream$2.write(COSStream.java:266)
at org.apache.pdfbox.pdfparser.COSParser.readValidStream(COSParser.java:1142)
at org.apache.pdfbox.pdfparser.COSParser.parseCOSStream(COSParser.java:970)
at org.apache.pdfbox.pdfparser.COSParser.parseFileObject(COSParser.java:781)
at org.apache.pdfbox.pdfparser.COSParser.parseObjectDynamically(COSParser.java:742)
at org.apache.pdfbox.pdfparser.COSParser.parseObjectDynamically(COSParser.java:673)
at org.apache.pdfbox.pdfparser.COSParser.parseDictObjects(COSParser.java:633)
at org.apache.pdfbox.pdfparser.PDFParser.initialParse(PDFParser.java:241)
at org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:276)
at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:1132)
at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:1066)
at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:141)
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:280)
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:280)
at org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:135)

Please let us know how to fix this issue

Issue Links

• is a clone of: TIKA-2045 TIKA crashes / runs out of memory on simple PDF