Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-6554

Speed up overseer operations for collections with stateFormat > 1

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.0, 6.0
    • Fix Version/s: 5.0, 6.0
    • Component/s: SolrCloud
    • Labels:
      None

      Description

      Right now (after SOLR-5473 was committed), a node watches a collection only if stateFormat=1 or if that node hosts at least one core belonging to that collection.

      This means that a node which is the overseer operates on all collections but watches only a few. So any read goes directly to zookeeper which slows down overseer operations.

      Let's have the overseer node watch all collections always and never remove those watches (except when the collection itself is deleted).

        Attachments

        1. SOLR-6554-workqueue-fixes.patch
          9 kB
          Shalin Shekhar Mangar
        2. SOLR-6554-workqueue-fixes.patch
          9 kB
          Shalin Shekhar Mangar
        3. SOLR-6554-workqueue-fixes.patch
          8 kB
          Shalin Shekhar Mangar
        4. SOLR-6554-batching-refactor.patch
          22 kB
          Shalin Shekhar Mangar
        5. SOLR-6554-batching-refactor.patch
          22 kB
          Shalin Shekhar Mangar
        6. SOLR-6554-batching-refactor.patch
          23 kB
          Shalin Shekhar Mangar
        7. SOLR-6554-batching-refactor.patch
          30 kB
          Shalin Shekhar Mangar
        8. SOLR-6554.patch
          140 kB
          Shalin Shekhar Mangar
        9. SOLR-6554.patch
          144 kB
          Shalin Shekhar Mangar
        10. SOLR-6554.patch
          141 kB
          Shalin Shekhar Mangar
        11. SOLR-6554.patch
          145 kB
          Shalin Shekhar Mangar
        12. SOLR-6554.patch
          143 kB
          Shalin Shekhar Mangar
        13. SOLR-6554.patch
          142 kB
          Shalin Shekhar Mangar
        14. SOLR-6554.patch
          143 kB
          Shalin Shekhar Mangar
        15. SOLR-6554.patch
          143 kB
          Shalin Shekhar Mangar

          Activity

            People

            • Assignee:
              shalinmangar Shalin Shekhar Mangar
              Reporter:
              shalinmangar Shalin Shekhar Mangar
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: