[HUDI-6613] New file format does not work with in memory index

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: spark
• Labels: pull-request-available
• Epic Link: Redesign Hudi Spark Integration
• Assignee: Jonathan Vexler
• Reporter: Jonathan Vexler
• Created: 30/Jul/23 15:31
• Updated: 12/Dec/23 17:50

Description

.option(HoodieIndexConfig.INDEX_TYPE.key, IndexType.INMEMORY.toString)

then the file index is empty so we need to get the files from glob paths

Issue Links

• links to: GitHub Pull Request #10062