[OAK-10183] large Bulk size for BulkProcessor sometimes lead to SocketTimeoutException

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.52.0
• Component/s: indexing
• Assignee: Mohit Kataria
• Reporter: Mohit Kataria
• Created: 10/Apr/23 14:31
• Updated: 15/May/23 16:54
• Resolved: 19/Apr/23 08:02

Description

Large Bulk size for BulkProcessor sometimes lead to SocketTimeoutException[1]. One solution is to decrease BulkSize.

 

[1]:

14:46:55.876 [I/O dispatcher 2] ERROR o.a.j.o.p.i.e.i.ElasticBulkProcessorHandler - ElasticIndex Update Bulk Failure : Bulk with id 5862 threw an error
java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-1 [ACTIVE]
	at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:387)
	at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92)
	at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39)
	at org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:261)
	at org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:502)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:211)
	at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
	at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
	at java.base/java.lang.Thread.run(Thread.java:834) 

Issue Links

• links to: GitHub Pull Request #892