[HUDI-3163] Validate/certify hudi against diff spark 3 versions

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Done
• Fix Version/s: 0.10.1
• Component/s: spark
• Labels: user-support-issues
• Story Points: 2
• Epic Link: Hudi Spark SQL
• Assignee: Shiyan Xu
• Reporter: sivabalan narayanan
• Created: 04/Jan/22 13:44
• Updated: 11/Jan/22 03:13
• Resolved: 11/Jan/22 03:09

Description

We have diff spark3 versions. Lets validate/certify diff spark3 versions against 0.10.1 and master.

 

I do see this in our github readme. If its already certified, feel free to close it out(link to original ticket where verifications are documented. 

# Build against Spark 3.2.0 (default build shipped with the public jars)
mvn clean package -DskipTests -Dspark3# Build against Spark 3.1.2
mvn clean package -DskipTests -Dspark3.1.x# Build against Spark 3.0.3
mvn clean package -DskipTests -Dspark3.0.x