[BIGTOP-3345] Failed to run smoke test due to jenkins do not have permission to cleanup workspace

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.4.0
• Component/s: ci
• Assignee: Unassigned
• Reporter: Evans Ye
• Created: 25/Apr/20 17:41
• Updated: 25/Apr/20 17:47

Description

Issue

ERROR: Failed to clean the workspace
jenkins.util.io.CompositeIOException: Unable to delete '/home/jenkins/workspace/Build-Deploy-Smoke-Test-Pull-Request-All-Distros/OS/centos-7-x86_64-deploy'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
	at jenkins.util.io.PathRemover.forceRemoveDirectoryContents(PathRemover.java:90)
	at hudson.Util.deleteContentsRecursive(Util.java:260)
	at hudson.Util.deleteContentsRecursive(Util.java:249)
	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:739)
	at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161)
	at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:154)
	at hudson.remoting.UserRequest.perform(UserRequest.java:211)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	Suppressed: java.nio.file.FileSystemException: /home/jenkins/workspace/Build-Deploy-Smoke-Test-Pull-Request-All-Distros/OS/centos-7-x86_64-deploy/bigtop-tests/smoke-tests/logger-test-config/build/resources/main/log4j.properties: Operation not permitted

Ref: https://ci.bigtop.apache.org/view/Test/job/Build-Deploy-Smoke-Test-Pull-Request-All-Distros/OS=centos-7-x86_64-deploy/52/consoleFull

Possible root cause

Guessing it's because the job error out early before the cleanup command getting executed:

./gradlew realclean docker-provisioner-destroy

Ref: https://issues.apache.org/jira/browse/BIGTOP-3344

Possible solution

• Small change: Run smoke test by jenkins instead of root.
• Large change: Refactor the docker provisioner to eliminate unsafe root execution inside container.