[TIKA-3596] Detect truncated/bad encoded XML files as application/xml instead of text/plain

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.27, 2.1.0
• Fix Version/s: 2.2.0, 1.28
• Component/s: detector
• Assignee: Luís Filipe Nassif
• Reporter: Luís Filipe Nassif
• Created: 20/Nov/21 19:23
• Updated: 18/Dec/21 12:47
• Resolved: 23/Nov/21 17:34

Description

There is a logic in MimeTypes class to return text/plain for corrupted xml files not detected as text/html here: https://github.com/apache/tika/blob/324f2f2ccff21c608969e2e79da88e71379a58dc/tika-core/src/main/java/org/apache/tika/mime/MimeTypes.java#L281

I think this should be changed to return application/xml, even if the file is corrupted, like is done for all other mimetypes, being more consistent across file formats. Even if a jpg or doc file is corrupted, image/jpg or application/msword is returned.

I have about ~2k from ~90k xml files in an internal corpus that trigger this.

If other fellow devs agree, I can submit a patch and unit test.