Details
Description
A small number of API's in Hadoop were added between 1.0.4 and 1.2.1. It appears this is one cause of SPARK-7843 since some Hive code relies on newer Hadoop API's. My feeling is we should just bump our tested version up to 1.2.1 (both versions are extremely old). If users are still on < 1.2.1 and run into some of these corner cases, we can consider doing some engineering and supporting the older versions. I'd like to bump our test version though and let this be driven by users, if they exist.
https://github.com/apache/spark/blob/master/dev/run-tests#L43
Attachments
Issue Links
- is related to
-
SPARK-7843 Several thrift server failures in Spark 1.4 sbt build with hadoop 1.0.4
- Resolved
- links to