Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1588

Support multiple ordering fields via payload class config

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.10.0
    • Component/s: Writer Core
    • Labels:
      None

      Description

      To make configuration simpler, we want to deprecate --source-ordering-field config and combine it with payload class config so that users can plug in custom payload class that handles record ordering. Also the logic can be extended to look up for multiple fields for ordering.

       

      Discussion thread

      https://lists.apache.org/thread.html/r884e47f21ce1f3f09ef12722fa05ba9900ba12429935c10167b9fce6%40%3Cdev.hudi.apache.org%3E

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              xushiyan Raymond Xu

              Dates

              • Created:
                Updated:

                Issue deployment