Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
4.0.0
-
None
Description
Although `IndexShuffleBlockResolver` is `private` and there is no contract to keep class constructor signitures, we had better reduce the following situations with the old libraries built against old Spark versions.
Cause: java.lang.NoSuchMethodError: 'void org.apache.spark.shuffle.IndexShuffleBlockResolver.<init>(org.apache.spark.SparkConf, org.apache.spark.storage.BlockManager)'
[info] at org.apache.spark.sql.comet.execution.shuffle.CometShuffleManager.<init>(CometShuffleManager.scala:64)