Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-2147

Large number of connections slows statistics.json responses.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.1
    • Component/s: None
    • Labels:
      None

      Description

      We observed that in our production environment with network monitoring being turned on.

      If there are many connections (> 10^4) in a container, getting socket information is expensive. It might take 1min to process all the socket information.

      One of the reason is that the library we are using (libnl) is not so optimized. Cong Wang has already submitted a patch:
      http://lists.infradead.org/pipermail/libnl/2014-November/001715.html

        Activity

        Hide
        jieyu Jie Yu added a comment -

        commit fe30f3db73437e7fdb7743dbfeec10758b1fe6d4
        Author: Jie Yu <yujie.jay@gmail.com>
        Date: Thu Nov 20 11:46:25 2014 -0800

        Allowed turning off network socket statistics collection.

        Review: https://reviews.apache.org/r/28295

        Show
        jieyu Jie Yu added a comment - commit fe30f3db73437e7fdb7743dbfeec10758b1fe6d4 Author: Jie Yu <yujie.jay@gmail.com> Date: Thu Nov 20 11:46:25 2014 -0800 Allowed turning off network socket statistics collection. Review: https://reviews.apache.org/r/28295
        Hide
        jieyu Jie Yu added a comment -

        A short term fix that disables this feature by default:
        https://reviews.apache.org/r/28295/

        Show
        jieyu Jie Yu added a comment - A short term fix that disables this feature by default: https://reviews.apache.org/r/28295/

          People

          • Assignee:
            jieyu Jie Yu
            Reporter:
            jieyu Jie Yu
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development

                Agile