[HUDI-1989] Flaky test : TestHoodieMergeOnReadTable

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Labels: pull-request-available
• Epic Link: Tests cleanup and fixes
• Assignee: Raymond Xu
• Reporter: sivabalan narayanan
• Created: 08/Jun/21 19:06
• Updated: 06/Jan/22 00:25
• Resolved: 03/Nov/21 12:09

Description

https://api.travis-ci.com/v3/job/512025273/log.txt

 

[ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 330.459 s <<< FAILURE! - in org.apache.hudi.table.TestHoodieMergeOnReadTable [ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers Time elapsed: 0.564 s <<< ERROR! java.lang.NullPointerException at org.apache.hudi.table.TestHoodieMergeOnReadTable.init(TestHoodieMergeOnReadTable.java:118) at org.apache.hudi.table.TestHoodieMergeOnReadTable.init(TestHoodieMergeOnReadTable.java:135) [INFO] [INFO] Results: [INFO] [ERROR] Errors: [ERROR] TestHoodieMergeOnReadTable.init:135->init:118->HoodieClientTestHarness.initDFS:255 » NullPointer

 

 

Couple of more failures

https://api.travis-ci.com/v3/job/512584741/log.txt

 

[ERROR] Tests run: 23, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 321.634 s <<< FAILURE! - in org.apache.hudi.table.TestHoodieMergeOnReadTable [ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList Time elapsed: 16.972 s <<< FAILURE! org.opentest4j.AssertionFailedError: There files should have been rolled-back when rolling back commit 002 but are still remaining. Files: [hdfs://localhost:41724/tmp/junit6050583652872512516/dataset/2015/03/17/14423e02-307a-42e2-b76f-71f39241d002-0_2-20-26_001.parquet] ==> expected: <0> but was: <1> at org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommit(TestHoodieMergeOnReadTable.java:646) at org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList(TestHoodieMergeOnReadTable.java:728) [ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers Time elapsed: 14.651 s <<< FAILURE! org.opentest4j.AssertionFailedError: There files should have been rolled-back when rolling back commit 002 but are still remaining. Files: [hdfs://localhost:36524/tmp/junit7236068081383159369/dataset/2015/03/16/002a31b1-2c2d-470b-bf45-d19451a04630-0_1-20-25_001.parquet] ==> expected: <0> but was: <1> at org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommit(TestHoodieMergeOnReadTable.java:646) at org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers(TestHoodieMergeOnReadTable.java:733) [INFO] [INFO] Results: [INFO] [ERROR] Failures: [ERROR] TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList:728->testRollbackWithDeltaAndCompactionCommit:646 There files should have been rolled-back when rolling back commit 002 but are still remaining. Files: [hdfs://localhost:41724/tmp/junit6050583652872512516/dataset/2015/03/17/14423e02-307a-42e2-b76f-71f39241d002-0_2-20-26_001.parquet] ==> expected: <0> but was: <1> [ERROR] TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers:733->testRollbackWithDeltaAndCompactionCommit:646 There files should have been rolled-back when rolling back commit 002 but are still remaining. Files: [hdfs://localhost:36524/tmp/junit7236068081383159369/dataset/2015/03/16/002a31b1-2c2d-470b-bf45-d19451a04630-0_1-20-25_001.parquet] ==> expected: <0> but was: <1> [INFO] [ERROR] Tests run: 393, Failures: 2, Errors: 0, Skipped: 1

 

 

 

 

Issue Links

• links to: GitHub Pull Request #3574
• links to: GitHub Pull Request #3597