Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12814

Metrics history causing "HttpParser URI is too large >8192" when many collections

    XMLWordPrintableJSON

Details

    Description

      If you have a lot of collections, like 50 or more, the new metrics page in version 7.5 can't run its queries because the default solr.jetty.request.header.size and solr.jetty.response.header.size values are too small.

      If I up the header values from 8192 to 65536 the commands will work.

      command to change the defaults:

      sed -i 's/\"solr.jetty.request.header.size\" default=\"8192\"/\"solr.jetty.request.header.size\" default=\"65536\"/g' /opt/solr/server/etc/jetty.xml 
      sed -i 's/\"solr.jetty.response.header.size\" default=\"8192\"/\"solr.jetty.response.header.size\" default=\"65536\"/g' /opt/solr/server/etc/jetty.xml
      

      before changing the header size log: 

      2018-09-27 13:06:45.434 INFO (qtp534906248-14) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
      2018-09-27 13:07:45.527 WARN (qtp534906248-17) [ ] o.e.j.h.HttpParser URI is too large >8192
      2018-09-27 13:07:45.530 INFO (qtp534906248-16) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
      2018-09-27 13:08:45.621 WARN (qtp534906248-20) [ ] o.e.j.h.HttpParser URI is too large >8192
      2018-09-27 13:08:45.625 INFO (qtp534906248-15) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
      2018-09-27 13:09:45.725 WARN (qtp534906248-20) [ ] o.e.j.h.HttpParser URI is too large >8192
      

      After changing the header size log:

      attached as a file because its very long and ugly

      Is it possible to break up this command into batches so that it can run without modifying the header sizes? 

      Thanks!
      -Matt

       

      Attachments

        1. screenshot-debug.png
          230 kB
          Jan Høydahl
        2. screencapture-nodes-actual-IP.png
          73 kB
          Shawn Heisey
        3. screencapture-cloud-graph.png
          337 kB
          Shawn Heisey
        4. longmetricsquery.txt
          10 kB
          matthew medway

        Issue Links

          Activity

            People

              janhoy Jan Høydahl
              mmedway matthew medway
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m