Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3304

Support partial update payload

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • 2

    Description

      current status

      • OverwriteNonDefaultsWithLatestAvroPayload implement partial update behavior in combineAndGetUpdateValue method
      • Spark sql also have a 'Merge into' syntax support partial update by ExpressionPayload,
      • both OverwriteNonDefaultsWithLatestAvroPayload and ExpressionPayload can not handle partial update in preCombine method, so they can only support partial update with COW table

      solution

      make preCombine function also support partial update(need pass schema as parameter)

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            fengjian_428 Jian Feng
            fengjian_428 Jian Feng
            Sagar Sumit, Shiyan Xu
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment