Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2435

A Sharding Split Policy For Load-Sharing Index Writes

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.1
    • None
    • core/index
    • None
    • New, Patch Available

    Description

      (Please note that the feature described in LUCENE-2425 is required reading for this issue.)

      The sharding split policy builds on the remoting split policy, treating each sub-index as a shard of the split index. Optionally, the super-index on which the split writer is built may also be considered to be a shard. The motivation for this policy is to allow a given index to be partitioned across multiple nodes (that define a cluster), which helps to (a) load-balance document writes across the nodes in that cluster and (b) serve search requests from a (narrower) set of sub-indices (that the split rule routes the query to).

      Unlike other sharding solutions for Lucene, this approach gives users the ability to (a) pick and choose the types of directories underlying the mirror, and (b) add/remove shards on the fly.

      Attachments

        1. LUCENE-2435.patch
          12 kB
          Karthick Sankarachary

        Issue Links

          Activity

            People

              Unassigned Unassigned
              karthick Karthick Sankarachary
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: