Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-10420

Solr 6.x leaking one SolrZkClient instance per second

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.5.2, 6.4.2, 6.5
    • Fix Version/s: 5.5.5, 5.6, 6.5.1, 6.6, 7.0
    • Component/s: None
    • Security Level: Public (Default Security Level. Issues are Public)
    • Labels:
      None

      Description

      One of our nodes became berzerk after a restart, Solr went completely nuts! So i opened VisualVM to keep an eye on it and spotted a different problem that occurs in all our Solr 6.4.2 and 6.5.0 nodes.

      It appears Solr is leaking one SolrZkClient instance per second via DistributedQueue$ChildWatcher. That one per second is quite accurate for all nodes, there are about the same amount of instances as there are seconds since Solr started. I know VisualVM's instance count includes objects-to-be-collected, the instance count does not drop after a forced garbed collection round.

      It doesn't matter how many cores or collections the nodes carry or how heavy traffic is.

        Attachments

        1. OverseerTest.106.stdout
          223 kB
          Steve Rowe
        2. OverseerTest.119.stdout
          329 kB
          Steve Rowe
        3. OverseerTest.80.stdout
          239 kB
          Steve Rowe
        4. OverseerTest.DEBUG.43.stdout
          820 kB
          Steve Rowe
        5. OverseerTest.DEBUG.48.stdout
          704 kB
          Steve Rowe
        6. OverseerTest.DEBUG.58.stdout
          759 kB
          Steve Rowe
        7. SOLR-10420.patch
          5 kB
          Cao Manh Dat
        8. SOLR-10420.patch
          4 kB
          Cao Manh Dat
        9. SOLR-10420.patch
          3 kB
          Cao Manh Dat
        10. SOLR-10420.patch
          5 kB
          Cao Manh Dat
        11. SOLR-10420.patch
          3 kB
          Cao Manh Dat
        12. SOLR-10420-dragonsinth.patch
          7 kB
          Scott Blum

          Activity

            People

            • Assignee:
              dragonsinth Scott Blum
              Reporter:
              markus17 Markus Jelsma
            • Votes:
              1 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: