Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1588

Support multiple ordering fields via payload class config

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 0.9.0
    • None
    • writer-core
    • None

    Description

      To make configuration simpler, we want to deprecate --source-ordering-field config and combine it with payload class config so that users can plug in custom payload class that handles record ordering. Also the logic can be extended to look up for multiple fields for ordering.

       

      Discussion thread

      https://lists.apache.org/thread.html/r884e47f21ce1f3f09ef12722fa05ba9900ba12429935c10167b9fce6%40%3Cdev.hudi.apache.org%3E

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-1355 Allowing multipleSourceOrdering fields for doing the preCombine on payload

          • Major - Major loss of function.
          • Closed
          is related to

          New Feature - A new feature of the product, which has yet to be developed. HUDI-1573 Spark Sql Writer support Multi preCmp Field

          • Major - Major loss of function.
          • Open

          Activity

            People

              Pratyaksh Pratyaksh Sharma
              xushiyan Raymond Xu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: