[HUDI-1302] Add support for timestamp field in HiveSync

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Component/s: hive
• Labels: pull-request-available
• Assignee: satish
• Reporter: satish
• Created: 28/Sep/20 17:06
• Updated: 26/Jan/21 00:19
• Resolved: 26/Jan/21 00:19

Description

Hudi HiveSyncTool converts int64 fields to 'bigint' hive type.

If the field has OriginalType as 'TIMESTAMP_MICROS', the field needs to converted into 'timestamp' hive type.

This has to be done in backward compatible way, so already synced tables will continue to get hive type as 'bigint'. We can enable 'timestamp' conversion manually.

Issue Links

• is part of: HUDI-83 Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync
• links to: GitHub Pull Request #2129