[SOLR-7129] CloudSolrClient can put extra load on ZooKeeper for collections with stateFormat=2

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 5.0
• Fix Version/s: 5.1, 6.0
• Component/s: SolrCloud, SolrJ
• Labels: difficulty-medium impact-high
• Assignee: Noble Paul
• Reporter: Shalin Shekhar Mangar
• Created: 19/Feb/15 19:34
• Updated: 09/May/16 18:47
• Resolved: 26/Feb/15 13:28

Description

Each stale state response from the server causes CloudSolrClient to evict the requested collection from the local cache. At this point, the request is retried and the latest collection state is fetched live from ZooKeeper. There is nothing preventing multiple request threads to simultaneously hit ZooKeeper and cause a thundering herd effect. There is synchronization to prevent multiple request threads from simultaneously trying to refresh the state but that is not enough. Each request thread which receives a stale state will sequentially refresh state from ZK after acquiring the lock.

We should use the past and current znode version of the cluster state to make sure that redundant fetches from ZooKeeper are never possible.

Issue Links

• duplicates: SOLR-7130 Make stale state notification work without failing the requests
• is part of: SOLR-7130 Make stale state notification work without failing the requests