Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-1293

Support for large no:of cores and faster loading/unloading of cores

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • 4.2
    • multicore
    • None

    Description

      Solr , currently ,is not very suitable for a large no:of homogeneous cores where you require fast/frequent loading/unloading of cores . usually a core is required to be loaded just to fire a search query or to just index one document
      The requirements of such a system are.

      • Very efficient loading of cores . Solr cannot afford to read and parse and create Schema, SolrConfig Objects for each core each time the core has to be loaded ( SOLR-919 , SOLR-920)
      • START STOP core . Currently it is only possible to unload a core (SOLR-880)
      • Automatic loading of cores . If a core is present and it is not loaded and a request comes for that load it automatically before serving up a request
      • As there are a large no:of cores , all the cores cannot be kept loaded always. There has to be an upper limit beyond which we need to unload a few cores (probably the least recently used ones)
      • Automatic allotment of dataDir for cores. If the no:of cores is too high al the cores' dataDirs cannot live in the same dir. There is an upper limit on the no:of dirs you can create in a unix dir w/o affecting performance

      Attachments

        1. SOLR-1293.patch
          37 kB
          Noble Paul

        Issue Links

          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-3980 Incorporate lazily-loaded cores into core listings for clients

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-4013 Creating a core should prevent more than one thread from creating a core of the same name at once.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. SOLR-1028 Automatic core loading unloading for multicore

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. SOLR-1106 Pluggable CoreAdminHandler (Action ) architecture that allows for custom handler access to CoreContainer / request-response

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. SOLR-1533 Partition data directories into multiple "bucket" directories

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-1416 reduce contention in CoreContainer#getCore()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Reopened

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-880 SolrCore should have a a lazy startup option

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-920 Cache and reuse IndexSchema

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-919 Cache and reuse the SolrConfig

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-921 SolrResourceLoader must cache short name vs fully qualified name

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-943 Make it possible to specify dataDir in solr.xml

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-1108 Remove synchronization in SolrCore constructor

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-1530 Open IndexSearcher lazily

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-1531 Provide an option to remove the data directory on core unload

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-1575 loading solr.xml takes a lot of time when there are lot of cores

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SOLR-1528 A non-200 response code gives no response body with wt=javabin

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. SOLR-1306 Support pluggable persistence/loading of solr.xml details

          • Major - Major loss of function.
          • Closed
          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-4196 Untangle XML-specific nature of Config and Container classes

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-4478 Allow cores to specify a named config set in non-SolrCloud mode

          • Major - Major loss of function.
          • Closed

          Activity

            People

              erickerickson Erick Erickson
              noble.paul Noble Paul
              Votes:
              16 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: