Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-574

parquet-hive-1.0.jar missing in hive jar path in v1.1.1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 1.1.1
    • Impala 1.2.1
    • None
    • None

    Description

      The parquet jar isn't getting picked up by the hive metastore in v1.1.1.
      Observed behavior:

      [impala:21000] > select * from foo;
      Query: select * from foo
      ERROR: AnalysisException: Failed to load metadata for table: default.foo
      CAUSED BY: TableLoadingException: Failed to load metadata for table: foo
      CAUSED BY: MetaException: org.apache.hadoop.hive.serde2.SerDeException SerDe parquet.hive.serde.ParquetHiveSerDe does not exist
      

      One solution is (as root) on the node running the hive metadata service:
      cd /usr/lib/hive/lib
      ln -s /usr/lib/impala/lib/parquet-hive-1.0.jar
      (restart hive metastore)

      for parcels use; ln -s /opt/cloudera/parcels/IMPALA/lib/impala/lib/parquet-hive-1.0.jar /opt/cloudera/parcels/CDH/lib/hive/lib/

      Adding parquet-hive-1.0.jar to the hive.aux.jars.path does not seem to resolve this issue. More investigation needed for a solution.

      Attachments

        Activity

          People

            ishaan Ishaan Joshi
            grahn Greg Rahn
            Votes:
            3 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: