[SPARK-25924] k8s integration tests on jenkins do not save log output

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Component/s: Kubernetes, Spark Core
• Assignee: Shane Knapp
• Reporter: Marcelo Masiero Vanzin
• Created: 02/Nov/18 01:31
• Updated: 17/May/20 18:23
• Resolved: 13/Nov/18 21:18

Description

The k8s integration test on jenkins does not seem to save any log files. So when the tests fail, you have extremely little information about what happened.

Especially with recent changes to the code, where even child process output is only logged and not printed as part of assertions anymore.

The normal PR builder saves a bunch of log files that are useful for debugging when things go wrong; these jobs should do the same.