[MESOS-2059] improve performance of expensive tests

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Labels: tech-debt
• Assignee: Unassigned
• Reporter: Dominic Hamon
• Created: 10/Nov/14 22:41
• Updated: 24/May/17 17:04
• Resolved: 30/Jul/15 22:31

Description

Many of our tests take a long time to run which has an impact on the developer compile-test cycle. Improving the performance of the worst cases can lead to a significant improvement in developer workflow.

A quick test shows that focusing on a few key test fixtures might be worthwhile:

$ egrep '\(.* ms\)$' test.log | cut -d\  -f10- | cut -d\  -f1-2 | sed 's/(//' | sort -k2 -rn | head -n 30
ZooKeeperMasterContenderDetectorTest.NonRetryableFrrors 15107
ZooKeeperMasterContenderDetectorTest.MasterDetectorExpireMasterZKSession 13473
ZooKeeperMasterContenderDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster 13434
ZooKeeperMasterContenderDetectorTest.MasterContenders 10089
ZooKeeperMasterContenderDetectorTest.MasterDetectorTimedoutSession 10081
ZooKeeperMasterContenderDetectorTest.ContenderDetectorShutdownNetwork 8459
ZooKeeperMasterContenderDetectorTest.MasterDetectorExpireSlaveZKSession 8424
ZooKeeperMasterContenderDetectorTest.MasterContender 8397
SlaveRecoveryTest/0.MultipleFrameworks 7971
ExamplesTest.PythonFramework 7326
HealthCheckTest.GracePeriod 6552
SlaveRecoveryTest/0.ReconcileKillTask 6150
ExamplesTest.LowLevelSchedulerPthread 6113
ExamplesTest.JavaFramework 5543
ExamplesTest.NoExecutorFramework 5391
ExamplesTest.TestFramework 5282
ExamplesTest.LowLevelSchedulerLibprocess 5282
ExamplesTest.JavaException 5177
ZooKeeperMasterContenderDetectorTest.ContenderPendingElection 5046
BasicMasterContenderDetectorTest.Detector 5010
BasicMasterContenderDetectorTest.Contender 5004
SlaveRecoveryTest/0.MultipleSlaves 4845
SlaveRecoveryTest/0.MasterFailover 4736
SlaveRecoveryTest/0.ShutdownSlave 4517
SlaveRecoveryTest/0.ShutdownSlaveSIGUSR1 4482
SlaveRecoveryTest/0.Reboot 4481
SlaveRecoveryTest/0.KillTask 3600
SlaveRecoveryTest/0.SchedulerFailover 3542
SlaveRecoveryTest/0.ReconcileShutdownFramework 3534
GroupTest.GroupJoinWithDisconnect 3384

Issue Links

• duplicates: MESOS-1757 Speed up the tests