Spark 3.4.0 was announced on April 14. https://lists.apache.org/thread/o1o9n1t036rmfp45q1jrjs0zzzx0j156
Findings from a quick test build using -Dspark.version=3.4.0:
- Incompatible logging api versions causes test failures.
- GeoParquet and Geotiff datasources fails to compile due to api changes in Spark.
Setting log4j and slf4j to the same versions as Spark 3.4.0 uses solves 1. I don't know how that will affect other Spark versions.
To solve 2 we might need to use reflection to handle the api changes in Spark.