[YUNIKORN-2295] [Umbrella] Stabilize E2E tests

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: test - e2e
• Assignee: Yu-Lin Chen
• Reporter: Yu-Lin Chen
• Created: 30/Dec/23 17:36
• Updated: 30/Dec/23 17:36

Description

This umbrella is to track and manage recent issues for improving E2E tests.

We already identified some issues:

• Resources not cleanup (YUNIKORN-2292, YUNIKORN-2293)
• Flaky test (YUNIKORN-2294)

If anyone discovers new issues or has new improvement ideas, feel free to edit this Jira and create sub-tasks.

Sub-Tasks

• Flaky E2E Test: Orphan pods still exist after TearDownNamespace(): Closed
• Flaky E2E Test: Failed asserts in LogTestClusterInfoWrapper() blocked the resources cleanup steps: Closed
• Flaky E2E Test: "Verify_Hard_GS_Failed_State" polling short-lived "Failing" application status: Closed
• Cleanup BinPacking e2e test workload before removing namespace: Closed
• Flaky E2E Test: "Verify_basic_preemption" experiences flakiness due to race condition: Closed
• "Test_With_Spark_Jobs" E2E test failed due to driver pod stuck in Running after job completed: Open