Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-5381 Split Clusterstate and scale
  3. SOLR-5477

Async execution of OverseerCollectionProcessor tasks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.8, 6.0
    • SolrCloud
    • None

    Description

      Typical collection admin commands are long running and it is very common to have the requests get timed out. It is more of a problem if the cluster is very large.Add an option to run these commands asynchronously

      add an extra param async=true for all collection commands

      the task is written to ZK and the caller is returned a task id.
      as separate collection admin command will be added to poll the status of the task

      command=status&id=7657668909

      if id is not passed all running async tasks should be listed

      A separate queue is created to store in-process tasks . After the tasks are completed the queue entry is removed. OverSeerColectionProcessor will perform these tasks in multiple threads

      Attachments

        1. SOLR-5477-updated.patch
          78 kB
          Anshum Gupta
        2. SOLR-5477-CoreAdminStatus.patch
          10 kB
          Anshum Gupta
        3. SOLR-5477.urlschemefix.patch
          1 kB
          Anshum Gupta
        4. SOLR-5477.patch
          33 kB
          Anshum Gupta
        5. SOLR-5477.patch
          33 kB
          Shalin Shekhar Mangar
        6. SOLR-5477.patch
          44 kB
          Anshum Gupta
        7. SOLR-5477.patch
          57 kB
          Anshum Gupta
        8. SOLR-5477.patch
          71 kB
          Anshum Gupta
        9. SOLR-5477.patch
          63 kB
          Anshum Gupta
        10. SOLR-5477.patch
          66 kB
          Anshum Gupta
        11. SOLR-5477.patch
          60 kB
          Anshum Gupta
        12. SOLR-5477.patch
          63 kB
          Anshum Gupta
        13. SOLR-5477.patch
          63 kB
          Anshum Gupta
        14. SOLR-5477.patch
          63 kB
          Anshum Gupta
        15. SOLR-5477.patch
          63 kB
          Anshum Gupta
        16. SOLR-5477.patch
          77 kB
          Anshum Gupta
        17. SOLR-5477.patch
          78 kB
          Anshum Gupta
        18. SOLR-5477.patch
          80 kB
          Anshum Gupta
        19. SOLR-5477.patch
          79 kB
          Anshum Gupta
        20. SOLR-5477.patch
          79 kB
          Anshum Gupta
        21. SOLR-5477.patch
          79 kB
          Anshum Gupta
        22. SOLR-5477.patch
          79 kB
          Shalin Shekhar Mangar
        23. SOLR-5477.patch
          77 kB
          Anshum Gupta
        24. SOLR-5477.patch
          78 kB
          Anshum Gupta
        25. SOLR-5477.patch
          97 kB
          Anshum Gupta

        Issue Links

          Activity

            People

              anshum Anshum Gupta
              noble.paul Noble Paul
              Votes:
              2 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: