[HUDI-6178] Fix flaky test testHoodieIndexer

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.1.0
• Component/s: tests-ci
• Epic Link: CI Instability
• Assignee: Unassigned
• Reporter: Ethan Guo (this is the old account; please use "yihua")
• Created: 04/May/23 16:29
• Updated: 21/Dec/23 15:29

Description

[ERROR] Tests run: 108, Failures: 0, Errors: 1, Skipped: 5, Time elapsed: 2,796.535 s <<< FAILURE! - in org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamer
[ERROR] testHoodieIndexer{HoodieRecordType}[2]  Time elapsed: 75.815 s  <<< ERROR!
    ... 8 more
Caused by: org.apache.hudi.exception.HoodieException: hoodie.properties file seems invalid. Please check for left over `.updated` files if any, manually copy it to hoodie.properties and retry
    at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$1(HoodieDeltaStreamer.java:756)
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
    ... 3 more
Caused by: java.lang.IllegalArgumentException: hoodie.properties file seems invalid. Please check for left over `.updated` files if any, manually copy it to hoodie.properties and retry
    at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:42)
    at org.apache.hudi.common.table.HoodieTableConfig.<init>(HoodieTableConfig.java:283)
    at org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:138)
    at org.apache.hudi.common.table.HoodieTableMetaClient.newMetaClient(HoodieTableMetaClient.java:689)
    at org.apache.hudi.common.table.HoodieTableMetaClient.access$000(HoodieTableMetaClient.java:81)
    at org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:770)
    at org.apache.hudi.client.BaseHoodieClient.createMetaClient(BaseHoodieClient.java:157)
    at org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1165)
    at org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1200)
    at org.apache.hudi.client.SparkRDDWriteClient.insert(SparkRDDWriteClient.java:163)
    at org.apache.hudi.utilities.deltastreamer.DeltaSync.writeToSink(DeltaSync.java:762)
    at org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:432)
    at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$1(HoodieDeltaStreamer.java:717)
    ... 4 more 

Issue Links

• is a child of: HUDI-5815 Investigate flaky tests