[HUDI-3056] Not able to query hudi tables in 0.10.0 with redshift

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 0.10.0
• Component/s: Usability
• Labels: query-engine sev:critical
• Assignee: Udit Mehrotra
• Reporter: sivabalan narayanan
• Created: 17/Dec/21 21:40
• Updated: 22/Feb/22 16:11

Description

Since with 0.10.0 we changed the format of timestamp, redshift is failing to read hudi tables created with 0.10.0 

 

I have noticed the instant timestamp length have changed from yyyyMMddHHmmss to yyyyMMddHHmmssSSS,
once I tried to use 'org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat', redshift shows 'hudi::ParsedFilename::IsValidCommitTimestamp( std::string(ctx.hudi_commit_timestamp))' error, I still have no idea why there is nothing return when using org.apache.hudi.hadoop.HoodieParquetInputFormat

{{}}

Ref issue: https://github.com/apache/hudi/issues/4283

{{}}

{{}}