Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7077

Hive contrib compilation maybe broken with removal of org.apache.hadoop.record

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.12.0, 0.13.0
    • 0.14.0
    • Contrib
    • None
    • Hadoop 2.4.0.5 and beyond

    Description

      Hadoop decided to move record to hadoop-streaming so the compilation of the contrib code will be broken if we do not include this jar.

      compile:
      [echo] Project: contrib
      [javac] Compiling 39 source files to /home/y/var/builds/thread2/workspace/Cloud-Hive-branch-0.12-Hadoop2-Component-JDK7/build/contrib/classes
      [javac] /home/y/var/builds/thread2/workspace/Cloud-Hive-branch-0.12-Hadoop2-Component-JDK7/contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesWritableOutput.java:47: error: package org.apache.hadoop.record does not exist
      [javac] import org.apache.hadoop.record.Record;
      [javac] ^
      [javac] /home/y/var/builds/thread2/workspace/Cloud-Hive-branch-0.12-Hadoop2-Component-JDK7/contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesOutput.java:30: error: package org.apache.hadoop.record does not exist
      [javac] import org.apache.hadoop.record.Buffer;
      [javac] ^
      [javac] /home/y/var/builds/thread2/workspace/Cloud-Hive-branch-0.12-Hadoop2-Component-JDK7/contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesWritableOutput.java:224: error: cannot find symbol
      [javac] public void writeRecord(Record r) throws IOException {
      [javac] ^
      [javac] symbol: class Record
      [javac] location: class TypedBytesWritableOutput
      [javac] /home/y/var/builds/thread2/workspace/Cloud-Hive-branch-0.12-Hadoop2-Component-JDK7/contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesInput.java:29: error: package org.apache.hadoop.record does not exist
      [javac] import org.apache.hadoop.record.Buffer;
      [javac] ^
      [javac] /home/y/var/builds/thread2/workspace/Cloud-Hive-branch-0.12-Hadoop2-Component-JDK7/contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesRecordInput.java:24: error: package org.apache.hadoop.record does not exist
      [javac] import org.apache.hadoop.record.Buffer;
      [javac] ^

      Besides this, https://issues.apache.org/jira/browse/HADOOP-10485 removes most of these classes. This Jira is being created to track this.

      Viraj

      Attachments

        1. HIVE-7077.patch
          15 kB
          Ashutosh Chauhan

        Issue Links

          Activity

            People

              ashutoshc Ashutosh Chauhan
              viraj Viraj Bhat
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: