[SOLR-433] MultiCore and SpellChecker replication

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.3
• Fix Version/s: 4.1
• Component/s: replication (scripts), spellchecker
• Assignee: Unassigned
• Reporter: Otis Gospodnetic
• Created: 08/Dec/07 06:56
• Updated: 24/Jan/13 06:33
• Resolved: 29/Oct/12 06:50

Description

With MultiCore functionality coming along, it looks like we'll need to be able to:
A) snapshot each core's index directory, and
B) replicate any and all cores' complete data directories, not just their index directories.

Pulled from the "spellchecker and multi-core index replication" thread - http://markmail.org/message/pj2rjzegifd6zm7m

Otis:

I think that makes sense - distribute everything for a given core, not just its index. And the spellchecker could then also have its data dir (and only index/ underneath really) and be replicated in the same fashion.

Right?

Ryan:

Yes, that was my thought. If an arbitrary directory could be distributed, then you could have

/path/to/dist/index/...
/path/to/dist/spelling-index/...
/path/to/dist/foo

and that would all get put into a snapshot. This would also let you put multiple cores within a single distribution:

/path/to/dist/core0/index/...
/path/to/dist/core0/spelling-index/...
/path/to/dist/core0/foo
/path/to/dist/core1/index/...
/path/to/dist/core1/spelling-index/...
/path/to/dist/core1/foo

Issue Links

• is duplicated by: SOLR-524 snappuller has limitation w/r/t/ handling multiple web apps
• is related to: SOLR-442 FileFloatSource should read file from dataDir, not indexDir
• relates to: SOLR-866 Support replicating arbitary indices and files with java replication