Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8128 Bring back table version 6 active timeline
  3. HUDI-7898

Add tests to validate 0.x tables are readable with 1.x hudi

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.0.0
    • tests-ci
    • None

    Description

      We need tests added to 1.x hudi to ensure it can read 0.16.0 tables. 

       

      We should have good coverage for all new log formats, diff table types, pending compactions, pending clustering, completed clustering, failed commits/delta commits, pending rollbacks, pending cleans etc. diff payloads, key gen, partitioned/non-partitioned. 

      Cover all different writers:

      a. spark ds writer

      b. spark sql

      c. deltastreamer 

      d. spark streaming writer 

       

      Reader side validation:

      lets account for snapshot read, incremental read, time travel read. 

       

      Attachments

        Issue Links

          Activity

            People

              shivnarayan sivabalan narayanan
              shivnarayan sivabalan narayanan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: