[PDFBOX-2252] PDFTextStripper has problem with documents with mixed language directions

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.8.6, 2.0.0
• Fix Version/s: 2.0.0
• Component/s: Text extraction
• Labels: Bidi
• Assignee: Maruan Sahyoun
• Reporter: Amir
• Created: 03/Aug/14 04:43
• Updated: 20/Mar/17 11:14
• Resolved: 03/Jan/17 07:37

Description

When the input document of PDFTextStripper is a combination of right-to-left and left-to-right languages, the output characters of one language is reversed.
A sample bilingual pdf document is attached.
PDFTextStripper has a variable "isRtlDominant" in "writePage" function, which is defined as follows: boolean isRtlDominant = rtlCount > ltrCount;
This class clearly count the number of rtl characters and decide if the whole content should be revered or not. It's not true, it must operate on each word, not the whole document.

Issue Links

• relates to: PDFBOX-3643 Improve text extraction for mixed language documents