[MESOS-2353] Improve performance of the state.json endpoint for large clusters.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.24.2, 0.25.1, 0.26.1, 0.27.0
• Component/s: master
• Labels: scalability twitter
• Target Version/s: 0.27.0
• Epic Link: json-perf
• Sprint: Twitter Mesos Q1 Sprint 5, Mesosphere Sprint 24, Mesosphere Sprint 25, Mesosphere Sprint 26
• Story Points: 5
• Assignee: Michael Park
• Reporter: Benjamin Mahler
• Shepherd: Benjamin Hindman
• Created: 14/Feb/15 01:20
• Updated: 27/Feb/16 00:23
• Resolved: 15/Jan/16 18:16

Description

The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:

$ time curl -s -o /dev/null localhost:5050/master/state.json
Mon Jan 26 22:38:50 UTC 2015

real	0m13.174s
user	0m0.003s
sys	0m0.022s

This can cause the master to get backlogged if there are many state.json requests in flight.

Looking at perf data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.

Issue Links

• is part of: MESOS-4235 JSON generation performance improvement