[TIKA-3832] Required array length is too large (OOM) error when reading a PDF file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.1
• Fix Version/s: 1.28.5, 2.5.0
• Component/s: parser
• Assignee: Unassigned
• Reporter: Lakatos Gyula
• Created: 05/Aug/22 12:00
• Updated: 14/Sep/22 18:26
• Resolved: 05/Aug/22 14:36

Description

I'm working on a web crawler and it got obliterated with an OutOfMemory error by a random PDF from the internet.

Exception in thread "main" java.lang.OutOfMemoryError: Required array length 2147483638 + 14 is too large
	at java.base/jdk.internal.util.ArraysSupport.hugeLength(ArraysSupport.java:649)
	at java.base/jdk.internal.util.ArraysSupport.newLength(ArraysSupport.java:642)
	at java.base/java.lang.AbstractStringBuilder.newCapacity(AbstractStringBuilder.java:257)
	at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:229)
	at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:740)
	at java.base/java.lang.StringBuffer.append(StringBuffer.java:410)
	at java.base/java.io.StringWriter.write(StringWriter.java:99)
	at org.apache.tika.sax.ToTextContentHandler.characters(ToTextContentHandler.java:108)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.WriteOutContentHandler.characters(WriteOutContentHandler.java:160)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.xpath.MatchingContentHandler.characters(MatchingContentHandler.java:81)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.SafeContentHandler.access$201(SafeContentHandler.java:47)
	at org.apache.tika.sax.SafeContentHandler.lambda$new$0(SafeContentHandler.java:57)
	at org.apache.tika.sax.SafeContentHandler.filter(SafeContentHandler.java:106)
	at org.apache.tika.sax.SafeContentHandler.characters(SafeContentHandler.java:250)
	at org.apache.tika.sax.XHTMLContentHandler.characters(XHTMLContentHandler.java:270)
	at org.apache.tika.sax.XHTMLContentHandler.characters(XHTMLContentHandler.java:295)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.extractBookmarkText(AbstractPDF2XHTML.java:977)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.extractBookmarkText(AbstractPDF2XHTML.java:981)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.extractBookmarkText(AbstractPDF2XHTML.java:959)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.endDocument(AbstractPDF2XHTML.java:907)
	at org.apache.pdfbox.text.PDFTextStripper.writeText(PDFTextStripper.java:239)
	at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:108)
	at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:196)
	at com.example.TikaOOMExample.main(TikaOOMExample.java:31)

I reproduced the error in this repository:
https://github.com/laxika/apache-tika-oom-reproduction

Uploaded the PDF into the attachments as well. It can be opened and read by the PDF readers I tried (Edge, Adobe, Chrome).

Issue Links

• is related to: TIKA-3413 Avoid ZipBomb detection in bookmark text extraction in PDFs