[HUDI-3339] Reuse or implement caching like the hive connector

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Epic Link: Hudi Trino Connector
• Assignee: Unassigned
• Reporter: Sagar Sumit
• Created: 28/Jan/22 11:40
• Updated: 10/Mar/23 01:02

Description

Reference: https://trino.io/docs/current/connector/hive-caching.html

The idea is to use the local storage of each worker and make the workers cache-aware so that they can request cached objects from other workers to avoid requests from the object storage.