[HUDI-1470] Hudi-test-suite - DFSHoodieDatasetInputReader.java - Use the latest writer schema, when reading the parquet files.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Component/s: Testing, tests-ci
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Balajee Nagasubramaniam
• Created: 18/Dec/20 00:12
• Updated: 27/Mar/22 15:00
• Resolved: 21/Jan/21 06:02

Description

In DFSHoodieDatasetInputReader, readParquetOrLogFiles(), when reading existing parquet files from a dataset, use the writer schema (latest/evolved schema) to mimic the Hudi writerCore behavior.

Issue Links

• links to: GitHub Pull Request #2344