[CONNECTORS-1260] Loop in emails processing

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: ManifoldCF 2.1
• Fix Version/s: ManifoldCF 2.3
• Component/s: Email connector
• Assignee: Karl Wright
• Reporter: Julien Massiera
• Created: 25/Nov/15 13:50
• Updated: 09/Mar/17 16:46
• Resolved: 26/Nov/15 14:45

Description

I noticed a loop in the emails processing, the manifoldcf job runs indefinitely. There are two kinds of errors in the manifoldcf.log file:

1) Unrecognized document identifier: '<044501d126bb$c91213c0$5b363b40$@francelabs.com>'
at org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.computePipelineSpecificationWithVersions(WorkerThread.java:2084)
at org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1503)
at org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1468)
at org.apache.manifoldcf.crawler.connectors.email.EmailConnector.processDocuments(EmailConnector.java:638)
at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:379)

2) Error tossed: java.lang.String cannot be cast to javax.mail.Multipart
java.lang.ClassCastException: java.lang.String cannot be cast to javax.mail.Multipart
at org.apache.manifoldcf.crawler.connectors.email.EmailConnector.processDocuments(EmailConnector.java:587)
at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:379)

I tried to debug and understand what happens but I didn't find anything.

Tested on gmail, ovh and windows.live, with IMAP protocol and the following job configuration:

• Metadata: To, From, Subject, Body and Date
• Filter: INBOX folder

Issue Links

• is related to: CONNECTORS-1396 Email processing multipart casting problem