[CASSANDRA-16128] Jenkins: dsl for website build, logging repo SHAs, and using nightlies.a.o instead of archiving

• Type: Task
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 2.2.19, 3.0.23, 3.11.9, 4.0-beta3, 4.0
• Component/s: CI
• Change Category: Quality Assurance
• Complexity: Normal
• Platform: All

Source Control Link

https://github.com/apache/cassandra/commit/aaef142f48c2bff43eb358f3901e5959ce8e6ebf

Test and Documentation Plan

ci-cassandra.a.o and devbranch testing before in-tree patch

• Assignee: Michael Semb Wever
• Reporter: Michael Semb Wever

Authors

Michael Semb Wever

Reviewers

Berenguer Blasi, Michael Semb Wever

• Created: 15/Sep/20 10:23
• Updated: 06/Apr/21 10:29
• Resolved: 30/Sep/20 20:43

Description

Jenkins improvements

1. Add the cassandra-website job into cassandra_job_dsl.seed.groovy (so we don't lose it next time the Jenkins master is corrupted)

2. Print the SHAs of the different git repos used during the build process. Also store them in the .head files (so the pipeline can print them out too).

3. Instead of archiving artefacts, ssh them to https://nightlies.apache.org/cassandra/
(Disk usage on agents is largely under control, but disk usage on master was the new problem. The suspicion here is the Cassandra-*-artifact's artefacts was the disk usage culprit, though we have to evidence to support it.)