Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-6136

ConcurrentUpdateSolrServer includes a Spin Lock

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 4.6, 4.6.1, 4.7, 4.7.1, 4.7.2, 4.8, 4.8.1
    • Fix Version/s: 4.10, 6.0
    • Component/s: SolrCloud
    • Labels:
      None

      Description

      ConcurrentUpdateSolrServer.blockUntilFinished() includes a Spin Lock. This causes an extremely high amount of CPU to be used on the Cloud Leader during indexing.

      Here is a summary of our system testing.

      Importing data on Solr4.5.0:
      Throughput gets as high as 240 documents per second.

      [tomcat@solr-stg01 logs]$ uptime
      09:53:50 up 310 days, 23:52, 1 user, load average: 3.33, 3.72, 5.43

      PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
      9547 tomcat 21 0 6850m 1.2g 16m S 86.2 5.0 1:48.81 java

      Importing data on Solr4.7.0 with no replicas:
      Throughput peaks at 350 documents per second.

      [tomcat@solr-stg01 logs]$ uptime
      10:03:44 up 311 days, 2 min, 1 user, load average: 4.57, 2.55, 4.18

      PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
      9728 tomcat 23 0 6859m 2.2g 28m S 62.3 9.0 2:20.20 java

      Importing data on Solr4.7.0 with replicas:
      Throughput peaks at 30 documents per second because the Solr machine is out of CPU.

      [tomcat@solr-stg01 logs]$ uptime
      09:40:04 up 310 days, 23:38, 1 user, load average: 30.54, 12.39, 4.79

      PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
      9190 tomcat 17 0 7005m 397m 15m S 198.5 1.6 7:14.87 java

        Attachments

        1. wait___notify_all.patch
          9 kB
          Brandon Chapman
        2. SOLR-6136.patch
          15 kB
          Timothy Potter

          Issue Links

            Activity

              People

              • Assignee:
                thelabdude Timothy Potter
                Reporter:
                bchapman Brandon Chapman
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: