Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-6554

Speed up overseer operations for collections with stateFormat > 1

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 5.0, 6.0
    • 5.0, 6.0
    • SolrCloud
    • None

    Description

      Right now (after SOLR-5473 was committed), a node watches a collection only if stateFormat=1 or if that node hosts at least one core belonging to that collection.

      This means that a node which is the overseer operates on all collections but watches only a few. So any read goes directly to zookeeper which slows down overseer operations.

      Let's have the overseer node watch all collections always and never remove those watches (except when the collection itself is deleted).

      Attachments

        1. SOLR-6554-workqueue-fixes.patch
          8 kB
          Shalin Shekhar Mangar
        2. SOLR-6554-workqueue-fixes.patch
          9 kB
          Shalin Shekhar Mangar
        3. SOLR-6554-workqueue-fixes.patch
          9 kB
          Shalin Shekhar Mangar
        4. SOLR-6554-batching-refactor.patch
          30 kB
          Shalin Shekhar Mangar
        5. SOLR-6554-batching-refactor.patch
          23 kB
          Shalin Shekhar Mangar
        6. SOLR-6554-batching-refactor.patch
          22 kB
          Shalin Shekhar Mangar
        7. SOLR-6554-batching-refactor.patch
          22 kB
          Shalin Shekhar Mangar
        8. SOLR-6554.patch
          143 kB
          Shalin Shekhar Mangar
        9. SOLR-6554.patch
          143 kB
          Shalin Shekhar Mangar
        10. SOLR-6554.patch
          142 kB
          Shalin Shekhar Mangar
        11. SOLR-6554.patch
          143 kB
          Shalin Shekhar Mangar
        12. SOLR-6554.patch
          145 kB
          Shalin Shekhar Mangar
        13. SOLR-6554.patch
          141 kB
          Shalin Shekhar Mangar
        14. SOLR-6554.patch
          144 kB
          Shalin Shekhar Mangar
        15. SOLR-6554.patch
          140 kB
          Shalin Shekhar Mangar

        Activity

          People

            shalin Shalin Shekhar Mangar
            shalin Shalin Shekhar Mangar
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: