[HUDI-5269] Enhancing core user flow tests for spark-sql writes

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Component/s: spark-sql, tests-ci
• Labels: pull-request-available
• Story Points: 6
• Assignee: Jonathan Vexler
• Reporter: Jonathan Vexler
• Created: 22/Nov/22 15:51
• Updated: 21/Dec/22 05:32
• Resolved: 29/Nov/22 13:49

Description

We triaged some of the core user flows and looks like we don't have a good coverage for those flows. 

 

1. 1. COW and MOR(w/ and w/o metadata enabled)
      1. Partitioned(BLOOM, SIMPLE, GLOBAL_BLOOM, }}BUCKET{{{}), non-partitioned(GLOBAL_BLOOM).
         1. 1. Unknown macro: {{Immutable data. pure bulk_insert row writing. }

               }

            2. Unknown macro: {{Immutable w/ file sizing. pure inserts. }

               }

            3. Unknown macro: {{initial bulk ingest, followed by updates. bulk_insert followed by upserts. }

               }

            4. regular inserts + updates combined{} { { ** }

               }

Issue Links

• is related to: HUDI-5193 Enhancing core user flow tests for spark-datasource writes
• links to: GitHub Pull Request #7230