Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-4509

Move to non deprecated HttpClient impl classes to remove stale connection check on every request and move connection lifecycle management towards the client.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      5 node SmartOS cluster (all nodes living in same global zone - i.e. same physical machine)

      Description

      By disabling the Apache HTTP Client stale check I've witnessed a 2-4x increase in throughput and reduction of over 100ms. This patch was made in the context of a project I'm leading, called Yokozuna, which relies on distributed search.

      Here's the patch on Yokozuna: https://github.com/rzezeski/yokozuna/pull/26

      Here's a write-up I did on my findings: http://www.zinascii.com/2013/solr-distributed-search-and-the-stale-check.html

      I'm happy to answer any questions or make changes to the patch to make it acceptable.

      ReviewBoard: https://reviews.apache.org/r/28393/

        Attachments

        1. 0001-SOLR-4509-Move-to-non-deprecated-HttpClient-impl-cla.patch
          240 kB
          Mark Miller
        2. 0001-SOLR-4509-Move-to-non-deprecated-HttpClient-impl-cla.patch
          249 kB
          Mark Miller
        3. 0001-SOLR-4509-Move-to-non-deprecated-HttpClient-impl-cla.patch
          242 kB
          Mark Miller
        4. 0001-SOLR-4509-Move-to-non-deprecated-HttpClient-impl-cla.patch
          212 kB
          Mark Miller
        5. 0001-SOLR-4509-Move-to-non-deprecated-HttpClient-impl-cla.patch
          157 kB
          Mark Miller
        6. 0001-SOLR-4509-Move-to-non-deprecated-HttpClient-impl-cla.patch
          114 kB
          Mark Miller
        7. SOLR-4509.patch
          64 kB
          Mark Miller
        8. SOLR-4509.patch
          251 kB
          Mark Miller
        9. SOLR-4509.patch
          277 kB
          Mark Miller
        10. SOLR-4509.patch
          232 kB
          Mark Miller
        11. SOLR-4509.patch
          129 kB
          Mark Miller
        12. SOLR-4509.patch
          26 kB
          Mark Miller
        13. SOLR-4509.patch
          24 kB
          Mark Miller
        14. SOLR-4509.patch
          20 kB
          Mark Miller
        15. SOLR-4509-4_4_0.patch
          4 kB
          Ryan Zezeski
        16. baremetal-stale-nostale-throughput.svg
          10 kB
          Ryan Zezeski
        17. baremetal-stale-nostale-throughput.dat
          0.3 kB
          Ryan Zezeski
        18. baremetal-stale-nostale-med-latency.svg
          11 kB
          Ryan Zezeski
        19. baremetal-stale-nostale-med-latency.dat
          0.3 kB
          Ryan Zezeski
        20. IsStaleTime.java
          0.9 kB
          Ryan Zezeski
        21. SOLR-4509.patch
          3 kB
          Ryan Zezeski

          Issue Links

            Activity

              People

              • Assignee:
                markrmiller@gmail.com Mark Miller
                Reporter:
                rzezeski Ryan Zezeski
              • Votes:
                4 Vote for this issue
                Watchers:
                22 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: