[HUDI-2519] [UMBRELLA] Seamless meta sync

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.0.0
• Component/s: hive
• Labels: hive hive3 hudi-umbrellas
• Epic Name: Seamless meta sync
• Assignee: Sagar Sumit
• Reporter: Sagar Sumit
• Due: 01/Nov/23
• Created: 04/Oct/21 15:18
• Updated: 11/Nov/23 07:15
• Start Date: 02/Oct/23

Description

Hudi to Hive sync is a common use case which enables querying Hudi tables through other query engines that support hive connector such as Presto and Trino. Currently, Hudi supports syncing to Hive asynchronously using run_sync_tool or synchronously through deltastreamer.

The goal of this umbrella JIRA is to imrpove the current sync mechanism and support Hive3. Additionally, we need to improve the documentation around different configs and sync modes.

Issue Links

• contains: HUDI-6 Support for Hive 3.x
• contains: HUDI-2649 Kick off all the Hive query issues for 0.10.0
• relates to: HUDI-3431 Certify Hudi against Spark3 Hive3 Hadoop3