Solr
  1. Solr
  2. SOLR-6459

Log all Overseer operations, queue size

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0, 6.0
    • Component/s: SolrCloud
    • Labels:
      None

      Description

      Currently the logging done by Overseer is inconsistent, some operations like cluster state changes are logged, while others like leadership transfers are not. Also, Overseer doesn't quite log how backlogged it is.These make it difficult to backtrack any issues with Overseer slowness.

        Activity

        Hide
        ASF GitHub Bot added a comment -

        GitHub user andyetitmoves opened a pull request:

        https://github.com/apache/lucene-solr/pull/91

        Log all Overseer operations, queue size

        Patch for SOLR-6459

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/bloomberg/lucene-solr trunk-overseer-logging

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/lucene-solr/pull/91.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #91


        commit 2b33aefe214587e26a65bdf94f6547517ab8182e
        Author: Ramkumar Aiyengar <raiyengar@bloomberg.net>
        Date: 2014-09-01T10:01:07Z

        Normalize logging of operations at Overseer


        Show
        ASF GitHub Bot added a comment - GitHub user andyetitmoves opened a pull request: https://github.com/apache/lucene-solr/pull/91 Log all Overseer operations, queue size Patch for SOLR-6459 You can merge this pull request into a Git repository by running: $ git pull https://github.com/bloomberg/lucene-solr trunk-overseer-logging Alternatively you can review and apply these changes as the patch at: https://github.com/apache/lucene-solr/pull/91.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #91 commit 2b33aefe214587e26a65bdf94f6547517ab8182e Author: Ramkumar Aiyengar <raiyengar@bloomberg.net> Date: 2014-09-01T10:01:07Z Normalize logging of operations at Overseer
        Hide
        ASF subversion and git services added a comment -

        Commit 1641218 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1641218 ]

        SOLR-6459: Normalize logging of operations in Overseer and log current queue size.

        Show
        ASF subversion and git services added a comment - Commit 1641218 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1641218 ] SOLR-6459 : Normalize logging of operations in Overseer and log current queue size.
        Hide
        ASF subversion and git services added a comment -

        Commit 1641220 from Mark Miller in branch 'dev/branches/branch_5x'
        [ https://svn.apache.org/r1641220 ]

        SOLR-6459: Normalize logging of operations in Overseer and log current queue size.

        Show
        ASF subversion and git services added a comment - Commit 1641220 from Mark Miller in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1641220 ] SOLR-6459 : Normalize logging of operations in Overseer and log current queue size.
        Hide
        Mark Miller added a comment -

        Thanks Ram!

        Show
        Mark Miller added a comment - Thanks Ram!
        Hide
        Shalin Shekhar Mangar added a comment -

        There is a bug here. The workQueue's size is passed to process message even when we are processing the stateUpdateQueue.

        Show
        Shalin Shekhar Mangar added a comment - There is a bug here. The workQueue's size is passed to process message even when we are processing the stateUpdateQueue.
        Hide
        Ramkumar Aiyengar added a comment -

        Ugh, I will fix this in a minute..

        Show
        Ramkumar Aiyengar added a comment - Ugh, I will fix this in a minute..
        Hide
        ASF GitHub Bot added a comment -

        GitHub user andyetitmoves opened a pull request:

        https://github.com/apache/lucene-solr/pull/109

        Use stateUpdateQueue using working off it for stats

        Fix for SOLR-6459.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/bloomberg/lucene-solr trunk-fix-solr-6459

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/lucene-solr/pull/109.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #109


        commit 0ac1ac1ca9b48a2b1201840dd21622b84d0d79dd
        Author: Ramkumar Aiyengar <andyetitmoves@gmail.com>
        Date: 2014-11-25T23:34:51Z

        Use stateUpdateQueue using working off it for stats


        Show
        ASF GitHub Bot added a comment - GitHub user andyetitmoves opened a pull request: https://github.com/apache/lucene-solr/pull/109 Use stateUpdateQueue using working off it for stats Fix for SOLR-6459 . You can merge this pull request into a Git repository by running: $ git pull https://github.com/bloomberg/lucene-solr trunk-fix-solr-6459 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/lucene-solr/pull/109.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #109 commit 0ac1ac1ca9b48a2b1201840dd21622b84d0d79dd Author: Ramkumar Aiyengar <andyetitmoves@gmail.com> Date: 2014-11-25T23:34:51Z Use stateUpdateQueue using working off it for stats
        Hide
        ASF subversion and git services added a comment -

        Commit 1641996 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1641996 ]

        SOLR-6459: Fix passing the wrong queue.

        Show
        ASF subversion and git services added a comment - Commit 1641996 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1641996 ] SOLR-6459 : Fix passing the wrong queue.
        Hide
        ASF subversion and git services added a comment -

        Commit 1642005 from Mark Miller in branch 'dev/branches/branch_5x'
        [ https://svn.apache.org/r1642005 ]

        SOLR-6459: Fix passing the wrong queue.

        Show
        ASF subversion and git services added a comment - Commit 1642005 from Mark Miller in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1642005 ] SOLR-6459 : Fix passing the wrong queue.
        Hide
        Mark Miller added a comment -

        Thanks Shalin and Ram!

        Show
        Mark Miller added a comment - Thanks Shalin and Ram!
        Hide
        ASF GitHub Bot added a comment -

        Github user andyetitmoves closed the pull request at:

        https://github.com/apache/lucene-solr/pull/91

        Show
        ASF GitHub Bot added a comment - Github user andyetitmoves closed the pull request at: https://github.com/apache/lucene-solr/pull/91
        Hide
        ASF GitHub Bot added a comment -

        Github user andyetitmoves closed the pull request at:

        https://github.com/apache/lucene-solr/pull/109

        Show
        ASF GitHub Bot added a comment - Github user andyetitmoves closed the pull request at: https://github.com/apache/lucene-solr/pull/109
        Hide
        Anshum Gupta added a comment -

        Bulk close after 5.0 release.

        Show
        Anshum Gupta added a comment - Bulk close after 5.0 release.

          People

          • Assignee:
            Mark Miller
            Reporter:
            Ramkumar Aiyengar
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development