Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2598

Redesign record payload class to decouple HoodieRecordPayload from Avro

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.13.0
    • code-quality
    • None

    Description

      We need to redesign the HoodieRecordPayload interface, which should not depend on avro, to pave the road for Spark Row writer work. Ideally, the new abstraction should have the individual implementation of avro-based record and spark-based Row, and the abstraction itself has more high-level operations like preCombine, getValue, etc., which are not tied to IndexedRecord. This should also make the write client easier to extend for Spark Dataset of Rows.

      Attachments

        Issue Links

          Activity

            People

              wzx Frank Wong
              guoyihua Ethan Guo (this is the old account; please use "yihua")
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: