[MESOS-2147] Large number of connections slows statistics.json responses.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.21.0
• Fix Version/s: 0.21.1
• Epic Link: Container Network Monitoring
• Sprint: Twitter Mesos Q4 Sprint 4
• Story Points: 2
• Assignee: Jie Yu
• Reporter: Jie Yu
• Created: 20/Nov/14 23:19
• Updated: 06/Dec/14 18:45
• Resolved: 06/Dec/14 18:44

Description

We observed that in our production environment with network monitoring being turned on.

If there are many connections (> 10^4) in a container, getting socket information is expensive. It might take 1min to process all the socket information.

One of the reason is that the library we are using (libnl) is not so optimized. Cong Wang has already submitted a patch:
http://lists.infradead.org/pipermail/libnl/2014-November/001715.html