[MESOS-6387] Improve reporting of parallel test runner.

• Type: Improvement
• Status: Accepted
• Priority: Major
• Resolution: Unresolved
• Component/s: test
• Labels: mesosphere newbie parallel-tests python
• Assignee: Unassigned
• Reporter: Benjamin Bannier
• Shepherd: Alex R
• Created: 13/Oct/16 20:05
• Updated: 29/Oct/19 06:30

Description

We should improve the logging of the parallel test runner. Improved logging seems to require some parsing of GoogleTest output, e.g., to prevent interleaving test output from concurrently executing tests.

We should add a verbose mode which can print results as they arrive from shards in order to not let users wonder if tests are executing.

We should also provide a way to properly unify output from different shards, e.g., report passed and failed tests in a single list instead of listing all shards separately (this e.g., makes tests from failed shards reported first harder to discover).

Distinguishing reports from tests run in parallel and sequentially might be useful as well.