[SPARK-27063] Spark on K8S Integration Tests timeouts are too short for some test clusters

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.4.0
• Component/s: Kubernetes, Spark Core
• Target Version/s: 3.0.0
• Assignee: Unassigned
• Reporter: Rob Vesse
• Created: 05/Mar/19 16:14
• Updated: 17/May/20 18:26
• Resolved: 18/Mar/19 11:30

Description

As noted during development for SPARK-26729 there are a couple of integration test timeouts that are too short when running on slower clusters e.g. developers laptops, small CI clusters etc

skonto confirmed that he has also experienced this behaviour in the discussion on PR PR 23846

We should up the defaults of this timeouts as an initial step and longer term consider making the timeouts themselves configurable

Issue Links

• links to: GitHub Pull Request #23980