Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-2419

Try HTML mime magic on broken XML files

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.15
    • Fix Version/s: None
    • Component/s: mime
    • Labels:
      None

      Description

      As noticed from the latest common crawl work, some url-hosted HTML files are being detected as text/plain then specialised out to their programming language url extension

      This is caused broken XML in the HTML, and by us having dropped the magic priority of HTML to 40 (below that of XML), to avoid it matching for HTML-containing other types like emails. Because these files have broken XML (eg an empty encoding on the xml tag), the XML root extractor doesn't run, and they get downmixed to text plain then specialised by filename

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              nick Nick Burch
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: