Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4139

pig query throws error java.lang.NoSuchFieldException: jobsInProgress on MRv1

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0, 0.11.1
    • Fix Version/s: 0.14.0, 0.13.1
    • Component/s: None
    • Labels:
      None
    • Environment:

      Pig jar running on yarn configured to run MRv1

    • Patch Info:
      Patch Available

      Description

      The following exception is caught and printed on stdout with logging level WARN under the environment mentioned above. Its a harmless msg and the pig job falls back to using HadoopShoms 0.20 API and completes successfully. But the exception can be confusing to the user. Increasing logging level to debug in the patch.


      2014-08-20 11:12:00,879 [main] WARN
      org.apache.pig.backend.hadoop23.PigJobControl - falling back to default
      JobControl (not using hadoop 0.23 ?)
      java.lang.NoSuchFieldException: jobsInProgress
      at java.lang.Class.getDeclaredField(Class.java:1899)
      at
      org.apache.pig.backend.hadoop23.PigJobControl.<clinit>(PigJobControl.java:58)
      at
      org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:104)
      at
      org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:287)
      at
      org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:192)
      at org.apache.pig.PigServer.launchPlan(PigServer.java:1322)
      at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1307)
      at org.apache.pig.PigServer.execute(PigServer.java:1297)
      at org.apache.pig.PigServer.executeBatch(PigServer.java:375)
      at org.apache.pig.PigServer.executeBatch(PigServer.java:353)
      at
      org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
      at
      org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:202)
      at
      org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
      at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
      at org.apache.pig.Main.run(Main.java:607)
      at org.apache.pig.Main.main(Main.java:156)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

      Also reported at -
      http://mail-archives.apache.org/mod_mbox/pig-user/201402.mbox/%3C2014022712405096933026@gmail.com%3E

      and

      http://stackoverflow.com/questions/17533154/pig-java-lang-nosuchfieldexception-jobsinprogress-exception

        Attachments

        1. PIG-4139.patch
          0.7 kB
          Suhas Satish

          Activity

            People

            • Assignee:
              suhassatish Suhas Satish
              Reporter:
              ssatish Suhas Satish
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: