Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1646

Allow support for pre-commit validation

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 0.8.0
    • None

    Description

      We have use cases where we want to support running hive/presto queries to validate data on uncommitted data. If validation passes, we will promote the commit. Otherwise, rollback the commit.

      This is not possible today because ParquetInputFormat supports only reading committed data.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            satishkotha satish
            satishkotha satish
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment