Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-1293

Support for large no:of cores and faster loading/unloading of cores

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • 4.2
    • multicore
    • None

    Description

      Solr , currently ,is not very suitable for a large no:of homogeneous cores where you require fast/frequent loading/unloading of cores . usually a core is required to be loaded just to fire a search query or to just index one document
      The requirements of such a system are.

      • Very efficient loading of cores . Solr cannot afford to read and parse and create Schema, SolrConfig Objects for each core each time the core has to be loaded ( SOLR-919 , SOLR-920)
      • START STOP core . Currently it is only possible to unload a core (SOLR-880)
      • Automatic loading of cores . If a core is present and it is not loaded and a request comes for that load it automatically before serving up a request
      • As there are a large no:of cores , all the cores cannot be kept loaded always. There has to be an upper limit beyond which we need to unload a few cores (probably the least recently used ones)
      • Automatic allotment of dataDir for cores. If the no:of cores is too high al the cores' dataDirs cannot live in the same dir. There is an upper limit on the no:of dirs you can create in a unix dir w/o affecting performance

      Attachments

        Issue Links

        incorporates

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-3980 Incorporate lazily-loaded cores into core listings for clients

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-4013 Creating a core should prevent more than one thread from creating a core of the same name at once.

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed
        is blocked by

        New Feature - A new feature of the product, which has yet to be developed. SOLR-1028 Automatic core loading unloading for multicore

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. SOLR-1106 Pluggable CoreAdminHandler (Action ) architecture that allows for custom handler access to CoreContainer / request-response

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. SOLR-1533 Partition data directories into multiple "bucket" directories

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-1416 reduce contention in CoreContainer#getCore()

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Reopened

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-880 SolrCore should have a a lazy startup option

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-920 Cache and reuse IndexSchema

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-919 Cache and reuse the SolrConfig

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-921 SolrResourceLoader must cache short name vs fully qualified name

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-943 Make it possible to specify dataDir in solr.xml

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-1108 Remove synchronization in SolrCore constructor

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-1530 Open IndexSearcher lazily

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-1531 Provide an option to remove the data directory on core unload

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-1575 loading solr.xml takes a lot of time when there are lot of cores

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed
        is related to

        Bug - A problem which impairs or prevents the functions of the product. SOLR-1528 A non-200 response code gives no response body with wt=javabin

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. SOLR-1306 Support pluggable persistence/loading of solr.xml details

        • Major - Major loss of function.
        • Closed
        is superceded by

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-4196 Untangle XML-specific nature of Config and Container classes

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SOLR-4478 Allow cores to specify a named config set in non-SolrCloud mode

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            erickerickson Erick Erickson
            noble.paul Noble Paul
            Votes:
            16 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment