Solr
  1. Solr
  2. SOLR-1951

extractingUpdateHandler doesn't close socket handles promptly, and indexing load tests eventually run out of resources

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: 1.4.1, 1.5
    • Fix Version/s: None
    • Component/s: update
    • Environment:

      sun java
      solr 1.5 build based on trunk
      debian linux "lenny"

      Description

      When multiple threads pound on extractingUpdateRequestHandler using multipart form posting over an extended period of time, I'm seeing a huge number of sockets piling up in the following state:

      tcp6 0 0 127.0.0.1:8983 127.0.0.1:44058 TIME_WAIT

      Despite the fact that the client can only have 10 sockets open at a time, huge numbers of sockets accumulate that are in this state:

      root@duck6:~# netstat -an | fgrep :8983 | wc
      28223 169338 2257840
      root@duck6:~#

      The sheer number of sockets lying around seems to eventually cause commons-fileupload to fail (silently - another bug) in creating a temporary file to contain the content data. This causes Solr to erroneously return a 400 code with "missing_content_data" or some such to the indexing poster.

      1. solr-1951.zip
        7 kB
        Karl Wright

        Activity

        Hoss Man made changes -
        Fix Version/s 1.5 [ 12313566 ]
        Status Reopened [ 4 ] Resolved [ 5 ]
        Fix Version/s 1.4.1 [ 12315096 ]
        Resolution Invalid [ 6 ]
        Hoss Man made changes -
        Resolution Fixed [ 1 ]
        Status Closed [ 6 ] Reopened [ 4 ]
        Karl Wright made changes -
        Status Open [ 1 ] Closed [ 6 ]
        Fix Version/s 1.4.1 [ 12315096 ]
        Fix Version/s 1.5 [ 12313566 ]
        Resolution Fixed [ 1 ]
        Karl Wright made changes -
        Field Original Value New Value
        Attachment solr-1951.zip [ 12447020 ]
        Karl Wright created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Karl Wright
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development