Uploaded image for project: 'ActiveMQ'
  1. ActiveMQ
  2. AMQ-6184

Improve nio transport scalability

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.13.0
    • Fix Version/s: 5.15.0
    • Component/s: None
    • Labels:
      None

      Description

      NIO transport uses unbounded thread pool executor to handle read operation. Under large number of connections and load, this could lead to large number of threads and eventually OOM errors. Which is the exact problem that nio transport is supposed to solve. Some work has been done in AMQ-5480, to make this configurable, but there's still more work to make it more robust. Creating a fixed thread pool with a queue in front gives much better results in my tests.

      Additionally, the same thread pool is used for accepting connections (AMQ-5269). This can lead to the broker not being able to accept new connections under the load. I got much better results when experimenting with implementing acceptor logic directly and handling it in the same thread (without reintroducing the old problem).

      With these two improvements in place, the broker accept and handle the number of connections up to the system limits.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gtully Gary Tully
                Reporter:
                dejanb Dejan Bosanac
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: