[SOLR-561] Solr replication by Solr (for windows also)

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4
• Fix Version/s: 1.4
• Component/s: replication (java)

Environment

All

• Assignee: Shalin Shekhar Mangar
• Reporter: Noble Paul
• Created: 05/May/08 09:58
• Updated: 02/May/13 02:29
• Resolved: 21/Oct/08 09:45

Description

The current replication strategy in solr involves shell scripts . The following are the drawbacks with the approach

• It does not work with windows
• Replication works as a separate piece not integrated with solr.
• Cannot control replication from solr admin/JMX
• Each operation requires manual telnet to the host

Doing the replication in java has the following advantages

• Platform independence
• Manual steps can be completely eliminated. Everything can be driven from solrconfig.xml .
  • Adding the url of the master in the slaves should be good enough to enable replication. Other things like frequency of
    snapshoot/snappull can also be configured . All other information can be automatically obtained.
• Start/stop can be triggered from solr/admin or JMX
• Can get the status/progress while replication is going on. It can also abort an ongoing replication
• No need to have a login into the machine
• From a development perspective, we can unit test it

This issue can track the implementation of solr replication in java

Issue Links

• depends upon: SOLR-647 Do SolrCore.close() in a refcounted way
• depends upon: SOLR-617 Allow configurable deletion policy
• depends upon: SOLR-605 Programatically register SolrEventListeners
• depends upon: SOLR-638 Enable access to MultiCore from SolrCore
• incorporates: SOLR-551 Solr replication should include the schema also
• is blocked by: SOLR-658 Allow Solr to load index from arbitrary directory in dataDir
• is related to: SOLR-727 appcontext, host and port of the Solr application must be available through API
• is related to: SOLR-1439 Enhance PollInterval for Java Replication
• is related to: SOLR-820 replicate After startup for new replication
• relates to: SOLR-327 shell scripts failed to run on Solaris 8 (and probably other non recent UNIX)
• relates to: SOLR-829 replication Compression
• relates to: SOLR-821 replication must allow copying conf file in a different name to slave
• relates to: SOLR-847 Enhance the snappull command in ReplicationHandler to take in masterUrl