[HUDI-7582] Fix NPE in FunctionalIndexSupport::loadFunctionalIndexDataFrame()

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0-beta2, 1.0.0
• Component/s: index
• Labels: hudi-1.0.0-beta2 pull-request-available
• Story Points: 4
• Epic Link: Indexing Functions
• Assignee: Sagar Sumit
• Reporter: Vinaykumar Bhat
• Created: 09/Apr/24 13:03
• Updated: 10/Jun/24 17:56
• Resolved: 16/Apr/24 08:17

Description

lookupCandidateFilesInMetadataTable(...) calls FunctionalIndexSupport::loadFunctionalIndexDataFrame() with an empty string for indexPartition which results in a NPE as loadFunctionalIndexDataFrame() tries to lookup and dereference index-definition using this empty string. 
 
This part of the code should never have worked - hence it looks like functional index (based on col-stats) is not tested on the query path. trying to get the index-partition to use on the query side seems more involved - the incoming query predicate needs to be parsed to get the (column-names, function-name) for all the query predicate and then fetch the corresponding index-partition by walking through the index-defs maintained in the index-metadata. 

Issue Links

• is depended upon by: HUDI-7007 Integrate functional index using bloom filter on reader side
• links to: GitHub Pull Request #11021