[TIKA-2578] Mails not recognized when unknown X-headers are present - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 1.17, 1.18, 2.0.0
Fix Version/s: 1.18, 2.0.0
Component/s: detector, mime
Labels:
None

Description

Found some mails with leading X-headers.

These mails are recognized as text/plain.

One example is CISCOs IronPort, which might add "X-IronPort-AV" to the beginning of mails.

Therefore I would like to discuss if and how TIKA shall handle these cases.

In my opinion TIKA should try to detect files with x-headers and preprocess them to get a valid mail.

Suggestion:

<mime-type type="text/x-tika-x-header">
  <magic priority="50">
    <match value="X-" type="string" offset="0">
      <match value="Message-ID:" type="string" offset="0:8192"/>
      <match value="From:" type="stringignorecase" offset="0:8192"/>
      <match value="To:" type="stringignorecase" offset="0:8192"/>
      <match value="Subject:" type="string" offset="0:8192"/>
      <match value="MIME-Version:" type="stringignorecase" offset="0:8192"/>
    </match>
  </magic>
  <sub-class-of type="text/x-tika-text-based-message"/>
</mime-type>