Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.4.0
-
Hadoop 2.6.x support is removed. The default Hadoop version in Spark 3.0.0 in 2.7.x.
Description
Hadoop 2.6 is now old, no releases have been done in 2 year and it doesn't look like they are patching it for security or bug fixes. We should stop supporting it in spark.