[SOLR-12642] SolrCmdDistributor should send updates in batch when use Http2SolrClient?

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.0
• Assignee: Cao Manh Dat
• Reporter: Cao Manh Dat
• Created: 08/Aug/18 08:39
• Updated: 28/Apr/20 01:40
• Resolved: 16/Dec/18 17:01

Description

In the past, batch updates are sent in a single stream from the leader, the replica will create a single thread to parse all the updates. For the simplicity of SOLR-12605, the leader is now sending individual updates to replicas, therefore they are now parsing updates in different threads which increase the usage of memory and CPU.
In the past, this is an unacceptable approach, because, for every update, we must create different connections to replicas. But with the support of HTTP/2, all updates will be sent in a single connection from leader to a replica. Therefore the cost is not as high as it used to be.

On the other hand, sending individual updates will improve the indexing performance and better error-handling for failures of a single update in a batch.

Issue Links

• is related to: SOLR-12639 Umbrella JIRA for adding support HTTP/2, jira/http2