[HUDI-6948] HoodieAvroParquetReader sets configs wrong (and prevents schema evolution with non row writer)

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.16.0, 1.0.0, 0.15.1
• Labels: pull-request-available
• Assignee: Jonathan Vexler
• Reporter: Jonathan Vexler
• Created: 16/Oct/23 23:09
• Updated: 12/Aug/24 19:44
• Resolved: 12/Aug/24 19:44

Description

tryOverrideDefaultConfigs sets the wrong config object. Inside the reader there are 2 different config objects. 

Setting the configs like 

ParquetReader<IndexedRecord> reader = new HoodieAvroParquetReaderBuilder<IndexedRecord>(path).withConf(conf)
.set(ParquetInputFormat.STRICT_TYPE_CHECKING, "false")
.set(AvroSchemaConverter.ADD_LIST_ELEMENT_RECORDS, "false")
.build(); 

will set the correct object I believe

Issue Links

• Discovered while testing: HUDI-6872 Simplify Out Of Box Schema Evolution Functionality
• links to: GitHub Pull Request #11731
• links to: GitHub Pull Request #11732