[HUDI-8716] Bug fixes and improvements on Secondary and Expression Index - Phase 1

• Type: Improvement
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Fix Version/s: 1.0.1
• Labels: story
• Assignee: Unassigned
• Reporter: Y Ethan Guo
• Created: 12/Dec/24 00:18
• Updated: 13/Dec/24 01:56

Sub-Tasks

• Refactor code in ExpressionIndexSupport to avoid duplicate code: Open
• Fix the usage of "hoodie.metadata.index.functional.enable" config: Open
• Extend secondary index to work as non-global index: Open
• Write functional tests for functional index for various write operations: Open
• Add validation for functional index in HoodieMetadataTableValidator: Open
• Chain multiple indices support in HoodieFileIndex: Open
• Automatically drop secondary index if record index is disabled or dropped: Open
• Improve expression index config experience: Open
• Fix gaps around hoodie.datasource.insert.dup.policy interplay with RLI or secondary index: Open
• Support bloom filter options like numHashFunctions and fpp with ExpressionIndex: Open