Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6865

Failed to load data into Hive from Pig using HCatStorer()

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.12.0
    • 1.2.0
    • HCatalog
    • None

    Description

      Reproduce steps:
      1. create a hive table
      hive> create table t1 (c1 int, c2 int, c3 int);

      2. start pig shell
      grunt> register $HIVE_HOME/lib/*.jar
      grunt> register $HIVE_HOME/hcatalog/share/hcatalog/*.jar
      grunt> A = load 'pig.txt' as (c1:int, c2:int, c3:int)
      grunt> store A into 't1' using org.apache.hive.hcatalog.HCatSrorer();

      Error Message:
      ERROR [main] org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to recreate exception from backend error: org.apache.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called
      at org.apache.hcatalog.mapreduce.HCatBaseOutputFormat.getJobInfo(HCatBaseOutputFormat.java:111)
      at org.apache.hcatalog.mapreduce.HCatBaseOutputFormat.getJobInfo(HCatBaseOutputFormat.java:97)
      at org.apache.hcatalog.mapreduce.HCatBaseOutputFormat.getOutputFormat(HCatBaseOutputFormat.java:85)
      at org.apache.hcatalog.mapreduce.HCatBaseOutputFormat.checkOutputSpecs(HCatBaseOutputFormat.java:75)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecsHelper(PigOutputFormat.java:207)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:187)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:1000)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:963)
      at java.security.AccessController.doPrivileged(AccessController.java:310)
      at javax.security.auth.Subject.doAs(Subject.java:573)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1502)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:963)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:616)
      at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
      at java.lang.reflect.Method.invoke(Method.java:611)
      at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
      at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
      at java.lang.Thread.run(Thread.java:738)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:270)

      Attachments

        Activity

          People

            libing Bing Li
            libing Bing Li
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: