[HUDI-8585] Fix unsupported data types for SPARK record type w/ col stats

• Type: Sub-task
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Fix Version/s: 1.0.1
• Component/s: metadata
• Assignee: sivabalan narayanan
• Reporter: sivabalan narayanan
• Created: 26/Nov/24 23:41
• Updated: 12/Dec/24 23:02

Description

When we tried enabling col stats by default, we realized that BYTES and FIXED data type is not supported in SPARK record type. 

 

Ref patch: 

https://github.com/apache/hudi/pull/12331 

 

Ref test: 

TestMORDataSource.testPrunedFiltered 

 

lets fix the user-exp by adding these as unsupported types upfront. rather than throwing random errors.