Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-2353

Improve performance of the state.json endpoint for large clusters.

    XMLWordPrintableJSON

Details

    • Twitter Mesos Q1 Sprint 5, Mesosphere Sprint 24, Mesosphere Sprint 25, Mesosphere Sprint 26
    • 5

    Description

      The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:

      $ time curl -s -o /dev/null localhost:5050/master/state.json
      Mon Jan 26 22:38:50 UTC 2015
      
      real	0m13.174s
      user	0m0.003s
      sys	0m0.022s
      

      This can cause the master to get backlogged if there are many state.json requests in flight.

      Looking at perf data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.

      Attachments

        Issue Links

          Activity

            People

              mcypark Michael Park
              bmahler Benjamin Mahler
              Benjamin Hindman Benjamin Hindman
              Votes:
              1 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: