[HUDI-2527] Flaky test: TestHoodieClientMultiWriter.testMultiWriterWithAsyncTableServicesWithConflict

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: Testing, tests-ci
• Labels: pull-request-available
• Epic Link: Tests cleanup and fixes
• Assignee: Manoj Govindassamy
• Reporter: Shiyan Xu

Reviewers

Shiyan Xu

• Created: 05/Oct/21 06:35
• Updated: 28/Apr/22 12:38
• Resolved: 28/Apr/22 12:38

Description

 

 [ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 61.795 s <<< FAILURE! - in org.apache.hudi.client.TestHoodieClientMultiWriter    [ERROR] org.apache.hudi.client.TestHoodieClientMultiWriter.testMultiWriterWithAsyncTableServicesWithConflict(HoodieTableType)[1] Time elapsed: 9.689 s <<< ERROR!    java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.hudi.exception.HoodieHeartbeatException: Unable to generate heartbeat     at org.apache.hudi.client.TestHoodieClientMultiWriter.testMultiWriterWithAsyncTableServicesWithConflict(TestHoodieClientMultiWriter.java:227)    Caused by: java.lang.RuntimeException: org.apache.hudi.exception.HoodieHeartbeatException: Unable to generate heartbeat     at org.apache.hudi.client.TestHoodieClientMultiWriter.lambda$testMultiWriterWithAsyncTableServicesWithConflict$5(TestHoodieClientMultiWriter.java:205)    Caused by: org.apache.hudi.exception.HoodieHeartbeatException: Unable to generate heartbeat     at org.apache.hudi.client.TestHoodieClientMultiWriter.createCommitWithInserts(TestHoodieClientMultiWriter.java:285)     at org.apache.hudi.client.TestHoodieClientMultiWriter.lambda$testMultiWriterWithAsyncTableServicesWithConflict$5(TestHoodieClientMultiWriter.java:202)    Caused by: org.apache.hadoop.util.Shell$ExitCodeException:    chmod: cannot access '/tmp/junit2134411362222342269/dataset/.hoodie/.heartbeat/.007.crc': No such file or directory       at org.apache.hudi.client.TestHoodieClientMultiWriter.createCommitWithInserts(TestHoodieClientMultiWriter.java:285)     at org.apache.hudi.client.TestHoodieClientMultiWriter.lambda$testMultiWriterWithAsyncTableServicesWithConflict$5(TestHoodieClientMultiWriter.java:202) 

[ERROR] Errors: 
[ERROR]   TestHoodieClientMultiWriter.testMultiWriterWithAsyncTableServicesWithConflict:227 » Execution

 
 
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=2352&view=logs&j=600e7de6-e133-5e69-e615-50ee129b3c08&t=bbbd7bcc-ae73-56b8-887a-cd2d6deaafc7

 

Test case does not make sense for COW table. Should remove COW from the test param.

Consider rewrite the prep logic.

Issue Links

• is duplicated by: HUDI-1706 Test flakiness w/ multiwriter test
• links to: GitHub Pull Request #4046