Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: 4.3, 5.0
    • Component/s: multicore
    • Labels:
      None

      Description

      If there are 1000's of cores the no:of times we need to load and parse the solrconfig.xml is going to be very expensive. It is desirable to just create one instance of SolrConfig object and re-use it across cores

      1. SOLR-919.patch
        15 kB
        Noble Paul

        Issue Links

          Activity

          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue depends upon SOLR-1198 [ SOLR-1198 ]
          Gavin made changes -
          Link This issue depends on SOLR-1198 [ SOLR-1198 ]
          Gavin made changes -
          Link This issue is depended upon by SOLR-920 [ SOLR-920 ]
          Gavin made changes -
          Link This issue blocks SOLR-920 [ SOLR-920 ]
          Erick Erickson made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 4.3 [ 12324128 ]
          Fix Version/s 4.2 [ 12323893 ]
          Resolution Won't Fix [ 2 ]
          Erick Erickson made changes -
          Link This issue is superceded by SOLR-4478 [ SOLR-4478 ]
          Erick Erickson made changes -
          Assignee Noble Paul [ noble.paul ] Erick Erickson [ erickerickson ]
          Mark Miller made changes -
          Fix Version/s 4.2 [ 12323893 ]
          Fix Version/s 5.0 [ 12321664 ]
          Fix Version/s 4.1 [ 12321141 ]
          Robert Muir made changes -
          Fix Version/s 4.1 [ 12321141 ]
          Fix Version/s 4.0 [ 12322551 ]
          Robert Muir made changes -
          Fix Version/s 4.0 [ 12322551 ]
          Fix Version/s 4.0-BETA [ 12322455 ]
          Hoss Man made changes -
          Fix Version/s 4.0 [ 12322455 ]
          Fix Version/s 4.0-ALPHA [ 12314992 ]
          Robert Muir made changes -
          Fix Version/s 3.6 [ 12319065 ]
          Simon Willnauer made changes -
          Fix Version/s 3.6 [ 12319065 ]
          Fix Version/s 3.5 [ 12317876 ]
          Robert Muir made changes -
          Fix Version/s 3.5 [ 12317876 ]
          Fix Version/s 3.4 [ 12316683 ]
          Robert Muir made changes -
          Fix Version/s 3.4 [ 12316683 ]
          Fix Version/s 4.0 [ 12314992 ]
          Fix Version/s 3.3 [ 12316471 ]
          Robert Muir made changes -
          Fix Version/s 3.3 [ 12316471 ]
          Fix Version/s 3.2 [ 12316172 ]
          Hoss Man made changes -
          Fix Version/s 3.2 [ 12316172 ]
          Fix Version/s Next [ 12315093 ]
          Hoss Man made changes -
          Fix Version/s Next [ 12315093 ]
          Fix Version/s 1.5 [ 12313566 ]
          Noble Paul made changes -
          Attachment SOLR-919.patch [ 12428035 ]
          Shalin Shekhar Mangar made changes -
          Component/s multicore [ 12313102 ]
          Shalin Shekhar Mangar made changes -
          Link This issue blocks SOLR-1293 [ SOLR-1293 ]
          Noble Paul made changes -
          Link This issue depends on SOLR-1198 [ SOLR-1198 ]
          Noble Paul made changes -
          Summary Cache and reuse the DOM object of solrconfig.xml Cache and reuse the SolrConfig
          Assignee Noble Paul [ noble.paul ]
          Fix Version/s 1.5 [ 12313566 ]
          Description If there are 1000's of cores the no:of times we need to load and parse the solrconfig.xml is going to be very expensive. In such a case we may mostly have same solrconfig.xml with some core properties embedded

          The solution is , if the location of the xml file is same (on disk) let us keep only one DOM object and reuse it for every other cores. So we can keep a cache at the CoreContainer level .

          We save file reading , XML parsing and RAM in one go

          The only challenge here is that it is we currently substitute core properties at read time. We will have to postpone this to consumption time. So whenever we read the values from the DOM the values can be substituted and used

          If there are 1000's of cores the no:of times we need to load and parse the solrconfig.xml is going to be very expensive. It is desirable to just create one instance of SolrConfig object and re-use it across cores


          Noble Paul made changes -
          Field Original Value New Value
          Link This issue blocks SOLR-920 [ SOLR-920 ]
          Noble Paul created issue -

            People

            • Assignee:
              Erick Erickson
              Reporter:
              Noble Paul
            • Votes:
              2 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development