[HUDI-69] Support realtime view in Spark datasource #136

• Type: New Feature
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: spark
• Labels: pull-request-available
• Assignee: Yanjia Gary Li
• Reporter: Vinoth Chandar
• Created: 06/Mar/19 02:16
• Updated: 17/Sep/24 18:22
• Resolved: 07/Aug/20 17:58

Description

https://github.com/uber/hudi/issues/136

RFC: https://cwiki.apache.org/confluence/display/HUDI/RFC+-+16+Abstraction+for+HoodieInputFormat+and+RecordReader

PR: https://github.com/apache/incubator-hudi/pull/1592

Issue Links

• causes: HUDI-8207 Unmerged reading is broken for spark relation implementation
• is a parent of: HUDI-1050 Support filter pushdown and column pruning for MOR table on Spark Datasource
• is a parent of: HUDI-1051 Improve MOR datasource reader file listing and path handling
• is a parent of: HUDI-1052 Support vectorized reader for MOR datasource reader
• is depended upon by: HUDI-920 Incremental view on MOR table using Spark Datasource
• is related to: HUDI-30 Explore support for Spark Datasource V2
• links to: GitHub Pull Request #1722
• links to: GitHub Pull Request #1848

Sub-Tasks

• Decouple hoodie related methods with Hoodie Input Formats: Closed