[SOLR-12977] Autoscaling policy initialisation tries to fetch metrics from dead nodes

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 7.6, 8.0
• Component/s: AutoScaling
• Assignee: Noble Paul
• Reporter: Shalin Shekhar Mangar
• Created: 08/Nov/18 22:35
• Updated: 08/Jun/19 15:01
• Resolved: 17/Jan/19 06:25

Description

Autoscaling policy initialisation tries to fetch metrics for each node during construction. However, it does not skip the known dead nodes causing a timeout to be logged. We should skip such requests entirely.

20579 WARN  (AutoscalingActionExecutor-37-thread-1) [    ] o.a.s.c.s.i.SolrClientNodeStateProvider could not get tags from node 127.0.0.1:63255_solr
org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:63255/solr
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650) ~[java/:?]
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) ~[java/:?]
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) ~[java/:?]
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1260) ~[java/:?]
	at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider$ClientSnitchCtx.invoke(SolrClientNodeStateProvider.java:342) ~[java/:?]
	at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.fetchReplicaMetrics(SolrClientNodeStateProvider.java:195) [java/:?]
	at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.fetchReplicaMetrics(SolrClientNodeStateProvider.java:186) [java/:?]
	at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.getReplicaInfo(SolrClientNodeStateProvider.java:169) [java/:?]
	at org.apache.solr.client.solrj.cloud.autoscaling.Row.<init>(Row.java:60) [java/:?]
	at org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:181) [java/:?]
	at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:114) [java/:?]
	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$419(ScheduledTriggers.java:308) [java/:?]