Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-8748

OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.10.4, 5.5
    • Fix Version/s: 5.5.1, 6.0
    • Component/s: SolrCloud
    • Labels:
      None

      Description

      OverseerTaskProcessor uses maxParallelThreads to limit number of concurrent tasks but the same is not used for creating the thread pool. The default limit of 10 is too small, IMO and we should change it to 100. The overseer collection processor mostly just waits around on network calls so there is no harm in increasing this limit.

      1. SOLR-8748.patch
        2 kB
        Shalin Shekhar Mangar

        Activity

        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit f1127db72c7ac247f25420c34b49b92f3e156dd7 in lucene-solr's branch refs/heads/branch_5_5 from Shalin Shekhar Mangar
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=f1127db ]

        SOLR-8748: OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100.

        Show
        jira-bot ASF subversion and git services added a comment - Commit f1127db72c7ac247f25420c34b49b92f3e156dd7 in lucene-solr's branch refs/heads/branch_5_5 from Shalin Shekhar Mangar [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=f1127db ] SOLR-8748 : OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 953949181992351cdad417d5fff05f1fcc5ee510 in lucene-solr's branch refs/heads/branch_5x from Shalin Shekhar Mangar
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=9539491 ]

        SOLR-8748: OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100.

        Show
        jira-bot ASF subversion and git services added a comment - Commit 953949181992351cdad417d5fff05f1fcc5ee510 in lucene-solr's branch refs/heads/branch_5x from Shalin Shekhar Mangar [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=9539491 ] SOLR-8748 : OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100.
        Hide
        anshumg Anshum Gupta added a comment -

        Reopening for 5.5.1

        Show
        anshumg Anshum Gupta added a comment - Reopening for 5.5.1
        Hide
        shalinmangar Shalin Shekhar Mangar added a comment -

        Shout out to Scott Blum for finding this bug.

        Show
        shalinmangar Shalin Shekhar Mangar added a comment - Shout out to Scott Blum for finding this bug.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit c59ca69ec008251d8e16ce05b71122c4abe75669 in lucene-solr's branch refs/heads/master from Shalin Shekhar Mangar
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=c59ca69 ]

        SOLR-8748: OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100.

        Show
        jira-bot ASF subversion and git services added a comment - Commit c59ca69ec008251d8e16ce05b71122c4abe75669 in lucene-solr's branch refs/heads/master from Shalin Shekhar Mangar [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=c59ca69 ] SOLR-8748 : OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100.
        Hide
        shalinmangar Shalin Shekhar Mangar added a comment -
        1. Renamed maxParallelThreads to a static constant MAX_PARALLEL_TASKS
        2. Increased value of constant to 100 from 10.
        Show
        shalinmangar Shalin Shekhar Mangar added a comment - Renamed maxParallelThreads to a static constant MAX_PARALLEL_TASKS Increased value of constant to 100 from 10.

          People

          • Assignee:
            shalinmangar Shalin Shekhar Mangar
            Reporter:
            shalinmangar Shalin Shekhar Mangar
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development