More info on this - apparently even removing the ignored default params in SolrCell doesn't fix it. I'm debugging more will report more soon.

OK here is some more info: apparently startDocument is invoked more than 1x on the TesseractOCR Tika output, causing the SolrContentHandler to reset builder fields, making the div field get stomped.

Got it! It's because of TIKA-1445 - to make sure we get ImageParser metadata, along with OCR text, we had to call the handler 2x. That's why startDocument is invoked 2x. There is probably a workaround though to be done in Solr, which is to flush the current field builder information if it hasn't been flushed yet. Going to whip up a patch, see if it fixes it, and if so, throw it up.

You can see the relevant Tika code here: http://svn.apache.org/repos/asf/tika/tags/1.7/tika-parsers/src/main/java/org/apache/tika/parser/ocr/TesseractOCRParser.java

• trivial patch that fixes SolrCell for OCR in 4.10.3 branch.

ok all fixed, hope you find it useful!

Hi Chris,
I understand the problem. We can add the workaround to SolrContentHandler until this double "startDocument" problem is solved in TIKA.

Chris A. Mattmann pointed me to TIKA-1445. The problems described there are causing the duplicate startDocument events. For TIKA 1.7 we can only work around by filtering them.

Hi,
I analyzed the whole thing. Basically, the simplest fix is to remove the whole startDocument() method because it does not do anything useful. The whole setup ffor a new document is already done by the constructor.
The startDocument setup looks like the original code writer wanted to "reuse" instances. But in fact this is never done (I checked extraction and morphlines).
I will attach a patch that removes the startDocument() and adds documentation to javadocs that you can only process one document.

Patch. This also makes the fields final to ensure no accidental reuse & co.

I would like to get this also in 4.10.4, because Mattman set this fix version and set "critical".

Commit 1662457 from Uwe Schindler in branch 'dev/trunk'
[ https://svn.apache.org/r1662457 ]

SOLR-7139: Fix SolrContentHandler for TIKA to ignore multiple startDocument events

Commit 1662461 from Uwe Schindler in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1662461 ]

Merged revision(s) 1662457 from lucene/dev/trunk:
SOLR-7139: Fix SolrContentHandler for TIKA to ignore multiple startDocument events

Commit 1662462 from Uwe Schindler in branch 'dev/branches/lucene_solr_4_10'
[ https://svn.apache.org/r1662462 ]

Merged revision(s) 1662457 from lucene/dev/trunk:
SOLR-7139: Fix SolrContentHandler for TIKA to ignore multiple startDocument events

Thank you Uwe Schindler! You rock!

Can you also confirm this in your case?

Sure I'll download the latest branch 4_10 and then test it out ASAP and report back.

There is already a RC: http://people.apache.org/~mikemccand/staging_area/lucene-solr-4.10.4-RC0-rev1662817/

awesome thanks Uwe and Mike. Will report back.

sorry haven't had a chance to test this yet. Hopefully tomorrow or Friday.

Bulk close for 4.10.4 release