Description
We need tests added to 1.x hudi to ensure it can read 0.16.0 tables.
We should have good coverage for all new log formats, diff table types, pending compactions, pending clustering, completed clustering, failed commits/delta commits, pending rollbacks, pending cleans etc. diff payloads, key gen, partitioned/non-partitioned.
Cover all different writers:
a. spark ds writer
b. spark sql
c. deltastreamer
d. spark streaming writer
Reader side validation:
lets account for snapshot read, incremental read, time travel read.
Attachments
Issue Links
- is a clone of
-
HUDI-7896 Add tests to validate 1.x tables are readable with 0.16.0 hudi
- Closed