[BEAM-6237] ULR ValidatesRunner tests not deleting artifacts.

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.11.0
• Component/s: runner-direct
• Assignee: Daniel Oliveira
• Reporter: Daniel Oliveira
• Created: 14/Dec/18 19:47
• Updated: 16/May/20 14:05
• Resolved: 25/Jan/19 19:17

Description

When running ValidatesRunner tests with the ULR, artifacts are never deleted. Since a new job is run per test, this uses up massive amounts of disk storage quickly (over 20 Gigabytes per execution). This often causes the machine running these tests to run out of disk space which means tests start failing.

The ULR should be modified to delete these artifacts after they have been staged to avoid this issue. Flink already does this, so the infrastructure exists.

Issue Links

• blocks: BEAM-5449 Add ValidatesRunner tests for the ULR, including automated Pre- and Post-commits.
• links to: GitHub Pull Request #7571