[SPARK-49785] Spark 3.5.3 does not compile

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.3
• Fix Version/s: 3.5.3
• Component/s: Build
• Target Version/s: 3.5.3
• Assignee: Yuming Wang
• Reporter: lione Herbet
• Created: 25/Sep/24 13:59
• Updated: 30/Sep/24 02:44
• Resolved: 30/Sep/24 02:44

Description

Issue :

When I build spark with the command

./dev/make-distribution.sh --name custom-spark -Phive -Phive-thriftserver -Pkubernetes

I have the following error :

[ERROR] [Error] /spark/sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala:570: not found: value CatalogManager
[ERROR] [Error] /spark/sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala:571: not found: type DelegatingCatalogExtension

Solution :

Align the 3.5.3 tag with all commit attached to 3.5.3-rc3 tag. The commit ba374c673634511373af551ba55691debd35904f which fix the build issue above is present in the 3.5.3-rc3 tag history (https://github.com/apache/spark/commits/v3.5.3-rc3/) but missing in the 3.5.3 tag history (https://github.com/apache/spark/commits/v3.5.3/).