[AMQ-6184] Improve nio transport scalability

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.13.0
• Fix Version/s: 5.15.0
• Assignee: Gary Tully
• Reporter: Dejan Bosanac
• Created: 25/Feb/16 11:06
• Updated: 28/Sep/16 09:27
• Resolved: 28/Sep/16 09:19

Description

NIO transport uses unbounded thread pool executor to handle read operation. Under large number of connections and load, this could lead to large number of threads and eventually OOM errors. Which is the exact problem that nio transport is supposed to solve. Some work has been done in AMQ-5480, to make this configurable, but there's still more work to make it more robust. Creating a fixed thread pool with a queue in front gives much better results in my tests.

Additionally, the same thread pool is used for accepting connections (AMQ-5269). This can lead to the broker not being able to accept new connections under the load. I got much better results when experimenting with implementing acceptor logic directly and handling it in the same thread (without reintroducing the old problem).

With these two improvements in place, the broker accept and handle the number of connections up to the system limits.

Issue Links

• is related to: AMQ-5486 Thread synchronization overhead is unexpectedly high