Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7712

hive-exec-0.13.0.2.1.2.0-402.jar contains avro classes compiled against hadoop-v1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Duplicate
    • 0.13.0
    • 0.14.0
    • None
    • None

    Description

      hive-exec-0.13.0.2.1.2.0-402.jar contains avro classes compiled against hadoop-v1.

      this causes issues on hadoop-v2 clusters where jobs are ran with this jar on the classpath.

      Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
      at org.apache.avro.mapreduce.AvroMultipleOutputs.getNamedOutputsList(AvroMultipleOutputs.java:208)
      at org.apache.avro.mapreduce.AvroMultipleOutputs.checkNamedOutputName(AvroMultipleOutputs.java:195)
      at org.apache.avro.mapreduce.AvroMultipleOutputs.addNamedOutput(AvroMultipleOutputs.java:259)
      at com.bol.searchrank.phase.calculate.CalculatePhaseRunner.createJob(CalculatePhaseRunner.java:70)
      

      the issue is obfuscated due to the shaded nature of the jar which has no avro version references within itself anymore - which should probably be fixed as well to prevent such issue in the future and aid debugging properly.

      Attachments

        Issue Links

          Activity

            People

              ashutoshc Ashutosh Chauhan
              frko Frank Kootte
              Votes:
              3 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: