[CLOUDSTACK-9348] CloudStack Server degrades when a lot of connections on port 8250 - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 4.9.0
Component/s: None
Security Level: Public (Anyone can view this level - this is the default.)
Labels:
None

Description

An intermittent issue was found with a large CloudStack deployment, where servers could not keep agents connected on port 8250.

All connections are handled by accept() in NioConnection:

https://github.com/apache/cloudstack/blob/master/utils/src/main/java/com/cloud/utils/nio/NioConnection.java#L125

A new connection is handled by accept() which does blocking SSL handshake. A good fix would be to make this non-blocking and handle expensive tasks in separate threads/pool. This way the main IO loop won't be blocked and can continue to serve other agents/clients.