Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Duplicate
-
0.13.0
-
None
-
None
Description
hive-exec-0.13.0.2.1.2.0-402.jar contains avro classes compiled against hadoop-v1.
this causes issues on hadoop-v2 clusters where jobs are ran with this jar on the classpath.
Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected at org.apache.avro.mapreduce.AvroMultipleOutputs.getNamedOutputsList(AvroMultipleOutputs.java:208) at org.apache.avro.mapreduce.AvroMultipleOutputs.checkNamedOutputName(AvroMultipleOutputs.java:195) at org.apache.avro.mapreduce.AvroMultipleOutputs.addNamedOutput(AvroMultipleOutputs.java:259) at com.bol.searchrank.phase.calculate.CalculatePhaseRunner.createJob(CalculatePhaseRunner.java:70)
the issue is obfuscated due to the shaded nature of the jar which has no avro version references within itself anymore - which should probably be fixed as well to prevent such issue in the future and aid debugging properly.
Attachments
Issue Links
- duplicates
-
HIVE-7240 Add classifier for avro-mapred jar
- Closed