[SOLR-12814] Metrics history causing "HttpParser URI is too large >8192" when many collections

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 7.5
• Fix Version/s: 7.5.1, 7.6, 8.0
• Component/s: metrics, SolrCloud
• Labels: URI header http httpparser large metrics solr solrcloud too uri

Environment

3x zookeeper and 3x solr cloud servers,

50 test collections with 0 data in them

• Assignee: Jan Høydahl
• Reporter: matthew medway
• Created: 27/Sep/18 13:17
• Updated: 08/Jun/19 15:01
• Resolved: 04/Oct/18 16:43

Description

If you have a lot of collections, like 50 or more, the new metrics page in version 7.5 can't run its queries because the default solr.jetty.request.header.size and solr.jetty.response.header.size values are too small.

If I up the header values from 8192 to 65536 the commands will work.

command to change the defaults:

sed -i 's/\"solr.jetty.request.header.size\" default=\"8192\"/\"solr.jetty.request.header.size\" default=\"65536\"/g' /opt/solr/server/etc/jetty.xml 
sed -i 's/\"solr.jetty.response.header.size\" default=\"8192\"/\"solr.jetty.response.header.size\" default=\"65536\"/g' /opt/solr/server/etc/jetty.xml

before changing the header size log: 

2018-09-27 13:06:45.434 INFO (qtp534906248-14) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2018-09-27 13:07:45.527 WARN (qtp534906248-17) [ ] o.e.j.h.HttpParser URI is too large >8192
2018-09-27 13:07:45.530 INFO (qtp534906248-16) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2018-09-27 13:08:45.621 WARN (qtp534906248-20) [ ] o.e.j.h.HttpParser URI is too large >8192
2018-09-27 13:08:45.625 INFO (qtp534906248-15) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2018-09-27 13:09:45.725 WARN (qtp534906248-20) [ ] o.e.j.h.HttpParser URI is too large >8192

After changing the header size log:

attached as a file because its very long and ugly

Is it possible to break up this command into batches so that it can run without modifying the header sizes? 

Thanks!
-Matt

 

Issue Links

• links to: GitHub Pull Request #461