[BEAM-9865] Clean up jenkins workspaces for successful jobs

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: build-system
• Assignee: Unassigned
• Reporter: Udi Meiri
• Created: 30/Apr/20 21:18
• Updated: 13/Jan/22 21:52
• Resolved: 15/May/21 17:58

Description

Two recent bugs (and many more in the past) citing lack of disk space:
https://issues.apache.org/jira/browse/BEAM-9854
https://issues.apache.org/jira/browse/BEAM-9462

There are around 150 workspaces on each Jenkins machine: apache-beam-jenkins-1..15.
Total size:
1: 175G
7: 158G
8: 173G

The majority of jobs use a clone of the Beam read/write files under src/, which is wiped out at the start of the job (wipeOutWorkspace()), so there is really no point in keeping workspace files around after the job has completed successfully.

Issue Links

• links to: GitHub Pull Request #12326