Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2435

A Sharding Split Policy For Load-Sharing Index Writes

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.1
    • Fix Version/s: None
    • Component/s: core/index
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      (Please note that the feature described in LUCENE-2425 is required reading for this issue.)

      The sharding split policy builds on the remoting split policy, treating each sub-index as a shard of the split index. Optionally, the super-index on which the split writer is built may also be considered to be a shard. The motivation for this policy is to allow a given index to be partitioned across multiple nodes (that define a cluster), which helps to (a) load-balance document writes across the nodes in that cluster and (b) serve search requests from a (narrower) set of sub-indices (that the split rule routes the query to).

      Unlike other sharding solutions for Lucene, this approach gives users the ability to (a) pick and choose the types of directories underlying the mirror, and (b) add/remove shards on the fly.

        Attachments

        1. LUCENE-2435.patch
          12 kB
          Karthick Sankarachary

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                karthick Karthick Sankarachary
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated: