[SOLR-7197] Can solr EntityProcessor implement curosrs

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 5.0
• Component/s: contrib - DataImportHandler

Environment

Prod

• Assignee: Unassigned
• Reporter: Raveendra Yerraguntl
• Created: 05/Mar/15 20:49
• Updated: 29/Aug/20 20:30
• Resolved: 29/Aug/20 20:30

Description

package org.apache.solr.handler.dataimport;

class SolrEntityProcessor

protected SolrDocumentList doQuery(int start) {
....

SolrQuery solrQuery = new SolrQuery(queryString);
solrQuery.setRows(rows);
solrQuery.setStart(start);
if (fields != null) {
for (String field : fields)

{ solrQuery.addField(field); }

}
solrQuery.setRequestHandler(requestHandler);
solrQuery.setFilterQueries(filterQueries);
solrQuery.setTimeAllowed(timeout * 1000);

QueryResponse response = null;
try

{ response = solrClient.query(solrQuery); }

catch (SolrServerException e) {
if (ABORT.equals(onError))

{ wrapAndThrow(SEVERE, e); }

else if (SKIP.equals(onError))

{ wrapAndThrow(DataImportHandlerException.SKIP_ROW, e); }

}

-------------------

If the do Query variant can be implemented with cursor, then it helps with any heavy lifting (bulk processing) with entity processor. That really helps.

If permitted I can contribute the fix. Currently I am using 4.10 and see the performance issues and planning the work around. If the cursor is available then it really helps.

Issue Links

• duplicates: SOLR-9668 Support cursor paging in SolrEntityProcessor
• is superceded by: SOLR-14783 Remove DIH from 9.0