[TIKA-2419] Try HTML mime magic on broken XML files

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.15
• Component/s: mime
• Assignee: Unassigned
• Reporter: Nick Burch
• Created: 05/Jul/17 13:57
• Updated: 05/Jul/17 16:03

Description

As noticed from the latest common crawl work, some url-hosted HTML files are being detected as text/plain then specialised out to their programming language url extension

This is caused broken XML in the HTML, and by us having dropped the magic priority of HTML to 40 (below that of XML), to avoid it matching for HTML-containing other types like emails. Because these files have broken XML (eg an empty encoding on the xml tag), the XML root extractor doesn't run, and they get downmixed to text plain then specialised by filename