Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-2353

Improve performance of the state.json endpoint for large clusters.

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Twitter Mesos Q1 Sprint 5, Mesosphere Sprint 24, Mesosphere Sprint 25, Mesosphere Sprint 26
    • 5

    Description

      The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:

      $ time curl -s -o /dev/null localhost:5050/master/state.json
      Mon Jan 26 22:38:50 UTC 2015
      
      real	0m13.174s
      user	0m0.003s
      sys	0m0.022s
      

      This can cause the master to get backlogged if there are many state.json requests in flight.

      Looking at perf data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mcypark Michael Park
            bmahler Benjamin Mahler
            Benjamin Hindman Benjamin Hindman
            Votes:
            1 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Agile

                Completed Sprints:
                Twitter Mesos Q1 Sprint 5 ended 30/Mar/15
                Mesosphere Sprint 24 ended 21/Dec/15
                Mesosphere Sprint 25 ended 04/Jan/16
                Mesosphere Sprint 26 ended 21/Jan/16
                View on Board

                Slack

                  Issue deployment