[SOLR-1927] DocBuilder Inefficiency

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Duplicate
• Affects Version/s: 1.4
• Labels: DIH DocBuilder
• Assignee: Unassigned
• Reporter: Robert Zotter
• Created: 25/May/10 19:12
• Updated: 01/Dec/13 15:57
• Resolved: 01/Dec/13 15:57

Description

I am looking into collectDelta method in DocBuilder.java and I noticed that
to determine the deltaRemoveSet it currently loops through the whole
deltaSet for each deleted row.

Does anyone else agree with the fact that this is quite inefficient?

For delta-imports with a large deltaSet and deletedSet I found a
considerable improvement in speed if we just save all deleted keys in a set.
Then we just have to loop through the deltaSet once to determine which rows
should be removed by checking if the deleted key set contains the delta row
key.

Issue Links

• duplicates: SOLR-2200 DIH DocBuilder - Improve perf. on large delta deletes