[HUDI-5785] Troubleshoot why TestMetadataTableWithSparkDataSource does not catch read issue

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.13.1, 0.12.3
• Labels: pull-request-available
• Story Points: 1
• Assignee: Ethan Guo
• Reporter: Ethan Guo
• Created: 14/Feb/23 01:55
• Updated: 30/Mar/23 02:22
• Resolved: 29/Mar/23 09:59

Description

HUDI-5768 discovers an issue with reading metadata table through Spark Datasource in Spark 3.  However, the functional test pass in Spark 3.  Need to understand why the test did not catch the issue.

mvn clean test -Dspark3.3 -Dscala-2.12 -DwildcardSuites="abc" -Dtest=TestMetadataTableWithSparkDataSource -DfailIfNoTests=false -pl hudi-spark-datasource/hudi-spark -am

Issue Links

• links to: GitHub Pull Request #7938