[TIKA-2711] When parsing a UNIX text file apostrophes are rendered as ?

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.18
• Fix Version/s: 2.0.0-BETA

Environment

Windows 10

• Assignee: Unassigned
• Reporter: Ichbiah
• Created: 17/Aug/18 19:02
• Updated: 21/Jul/21 22:13

Description

I have a small text file in two versions:

• a dos version of the file
• a unix version of the file

Both contain the same text below:

La politique macroéconomique cesse officiellement d’être
l’alpha et l’oméga de la lutte contre le chômage.

When I parse them using the tika-app.jar, the text is correctly "extracted" from the DOS version of the file. For the UNIX version of the file the apostrophes are falsely rendered as question marks.