[HUDI-1646] Allow support for pre-commit validation

• Type: New Feature
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Labels: pull-request-available
• Assignee: satish
• Reporter: satish
• Created: 01/Mar/21 04:44
• Updated: 10/Mar/21 19:23
• Resolved: 10/Mar/21 19:23

Description

We have use cases where we want to support running hive/presto queries to validate data on uncommitted data. If validation passes, we will promote the commit. Otherwise, rollback the commit.

This is not possible today because ParquetInputFormat supports only reading committed data.

Issue Links

• links to: GitHub Pull Request #2611