Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2710

Oozie HCatalog example workflow fails

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0
    • Component/s: core, examples
    • Labels:
      None

      Description

      Oozie HCatalog example workflow fails with the below exception:

      2016-10-12 10:33:37,260 [uber-SubtaskRunner] ERROR org.apache.pig.PigServer  - exception during parsing: Error during parsing. Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
      Failed to parse: Pig script failed to parse: 
      <file id.pig, line 18, column 33> pig script failed to validate: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
      	at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
      	at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1819)
      	at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1527)
      	at org.apache.pig.PigServer.parseAndBuild(PigServer.java:460)
      	at org.apache.pig.PigServer.executeBatch(PigServer.java:485)
      	at org.apache.pig.PigServer.executeBatch(PigServer.java:471)
      	at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:172)
      	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:235)
      	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:206)
      	at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
      	at org.apache.pig.Main.run(Main.java:501)
      	at org.apache.pig.PigRunner.run(PigRunner.java:49)
      	at org.apache.oozie.action.hadoop.PigMain.runPigJob(PigMain.java:290)
      	at org.apache.oozie.action.hadoop.PigMain.run(PigMain.java:233)
      	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:60)
      	at org.apache.oozie.action.hadoop.PigMain.main(PigMain.java:73)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:497)
      	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:232)
      	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
      	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
      	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:380)
      	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:301)
      	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
      	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: 
      <file id.pig, line 18, column 33> pig script failed to validate: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
      	at org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1339)
      	at org.apache.pig.parser.LogicalPlanBuilder.buildFuncSpec(LogicalPlanBuilder.java:1324)
      	at org.apache.pig.parser.LogicalPlanGenerator.func_clause(LogicalPlanGenerator.java:5184)
      	at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3515)
      	at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
      	at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
      	at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
      	at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
      	at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
      	... 32 more
      Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
      	at org.apache.pig.impl.PigContext.resolveClassName(PigContext.java:671)
      	at org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1336)
      	... 40 more
      

      job.properties file:

      nameNode=hdfs://host:8020
      jobTracker=host:8050
      queueName=default
      examplesRoot=examples
      oozie.use.system.libpath=true
      oozie.action.sharelib.for.pig=pig,hive,hcatalog
      
      oozie.coord.application.path=${nameNode}/user/${user.name}/${examplesRoot}/apps/hcatalog
      hcatNode=hcat://host:9083
      db=default
      table=invites
      start=2010-01-01T01:00Z
      end=2010-01-01T01:20Z
      workflowAppUri=${nameNode}/user/${user.name}/${examplesRoot}/apps/hcatalog
      dataOut=2011-01-01
      outputtable=oozie
      region=usa
      

        Attachments

        1. OOZIE-2710-00.patch
          4 kB
          Abhishek Bafna

          Activity

            People

            • Assignee:
              abhishekbafna Abhishek Bafna
              Reporter:
              abhishekbafna Abhishek Bafna
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: