[HUDI-7328] Fix flaky TestHoodieJavaClientOnCopyOnWriteStorage

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: tests-ci
• Story Points: 2
• Epic Link: CI Instability
• Assignee: Lin Liu
• Reporter: Lin Liu
• Created: 24/Jan/24 00:27
• Updated: 29/Mar/24 02:17

Description

TestHoodieJavaClientOnCopyOnWriteStorage could nondeterministically stop the JVM to shutdown, which causes the some CI modules to timeout. 

 

How to reproduce: run the following commands 10+ times to find it would block the terminal.

mvn clean -Dscala-2.12 -Dspark3.2  install -DskipTests -T 2C -am

mvn test -Punit-tests -fae -Dspark3.2 -Dscala-2.12 -pl hudi-client/hudi-java-client  -e -ntp -B -V -Dgpg.skip -Djacoco.skip -Pwarn-log -Dorg.slf4j.simpleLogger.log.org.apache.maven.plugins.shade=warn -Dorg.slf4j.simpleLogger.log.org.apache.maven.plugins.dependency=warn -Dmaven.wagon.httpconnectionManager.ttlSeconds=25 -Dmaven.wagon.http.retryHandler.count=5 -Dtest=TestHoodieJavaClientOnCopyOnWriteStorage