[CASSANDRA-15729] Jenkins Test Results Report in plaintext for ASF ML - ASF JIRA

Agile Board

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Task
Status: Resolved
Priority: Normal
Resolution: Fixed
Fix Version/s: 2.2.17, 3.0.21, 3.11.7, 4.0-beta1, 4.0
Component/s: Build, CI
Labels:
- CI
- Jenkins

Change Category:
Code Clarity
Complexity:
Normal
Platform:

All
Impacts:

None
Source Control Link:

https://github.com/apache/cassandra/commit/94aee924e2d6b57ce3ecf90d39114246c4f7ec70
Test and Documentation Plan:

Hide

Ran via Circle CI to validate XML

Show
Ran via Circle CI to validate XML

Description

The Jenkins pipeline builds now aggregate all test reports.

For example:

But Jenkins can only keep a limited amount of build history, so those links are not permanent, can't be used as references, and don't help for bisecting and blame on regressions (and flakey tests) over a longer period of time.

The builds@ ML can provide a permanent record of test results.

This was first brought up in these two threads:

An example plaintext report, to demonstrate feasibility, is available here: https://lists.apache.org/thread.html/r80d13f7af706bf8dfbf2387fab46004c1fbd3917b7bc339c49e69aa8%40%3Cbuilds.cassandra.apache.org%3E

Hurdles:

the ASF mailing lists won't accept html, attachments, or any message body over 1MB.
packages are used as a differentiator in the final aggregated report. The cqlsh and dtests currently don't specify it. It needs to be added as a "dot-separated" prefix to the testsuite and testcase name.