[HUDI-4899] Fix incompatibility w/ Spark 3.2.2

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.12.0
• Fix Version/s: 0.12.1
• Labels: pull-request-available
• Story Points: 2
• Epic Link: Hudi Spark Datasource
• Assignee: Alexey Kudinkin
• Reporter: Alexey Kudinkin

Reviewers

Shiyan Xu

• Created: 23/Sep/22 00:05
• Updated: 24/Sep/22 00:15
• Resolved: 24/Sep/22 00:15

Description

As reported by the user:
In spark 3.2.1, ProjectionOverSchema has a argument. But in spark 3.2.2 and spark 3.3.0, ProjectionOverSchema has 2 arguments. Spark32NestedSchemaPruning.scala is not compatible with spark 3.2.2.????

 

More context in:

https://github.com/apache/hudi/issues/6635

 

Issue Links

• links to: GitHub Pull Request #6755