[HUDI-5825] Disable Spark UI in tests if SPARK_EVLOG_DIR not set

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Implemented
• Fix Version/s: 0.13.1
• Component/s: tests-ci
• Labels: pull-request-available
• Epic Link: CI tests improvements
• Assignee: kazdy
• Reporter: kazdy
• Created: 21/Feb/23 14:55
• Updated: 24/Feb/23 11:35
• Resolved: 24/Feb/23 11:35

Description

Disable spark UI in tests if no SPARK_EVLOG_DIR is specified.
There's no reason for Spark UI to be enabled for tests in most cases.
If that's a requirement one can set SPARK_EVLOG_DIR to enable it.
In the Spark project UI is disabled for tests, with some minor exceptions (testing metrics available via UI). I think we can follow.
Hopefullt this will make tests a bit faster.

Issue Links

• links to: GitHub Pull Request #8005