Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4139

pig query throws error java.lang.NoSuchFieldException: jobsInProgress on MRv1

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0, 0.11.1
    • Fix Version/s: 0.14.0, 0.13.1
    • Component/s: None
    • Labels:
      None
    • Environment:

      Pig jar running on yarn configured to run MRv1

    • Patch Info:
      Patch Available

      Description

      The following exception is caught and printed on stdout with logging level WARN under the environment mentioned above. Its a harmless msg and the pig job falls back to using HadoopShoms 0.20 API and completes successfully. But the exception can be confusing to the user. Increasing logging level to debug in the patch.


      2014-08-20 11:12:00,879 [main] WARN
      org.apache.pig.backend.hadoop23.PigJobControl - falling back to default
      JobControl (not using hadoop 0.23 ?)
      java.lang.NoSuchFieldException: jobsInProgress
      at java.lang.Class.getDeclaredField(Class.java:1899)
      at
      org.apache.pig.backend.hadoop23.PigJobControl.<clinit>(PigJobControl.java:58)
      at
      org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:104)
      at
      org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:287)
      at
      org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:192)
      at org.apache.pig.PigServer.launchPlan(PigServer.java:1322)
      at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1307)
      at org.apache.pig.PigServer.execute(PigServer.java:1297)
      at org.apache.pig.PigServer.executeBatch(PigServer.java:375)
      at org.apache.pig.PigServer.executeBatch(PigServer.java:353)
      at
      org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
      at
      org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:202)
      at
      org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
      at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
      at org.apache.pig.Main.run(Main.java:607)
      at org.apache.pig.Main.main(Main.java:156)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

      Also reported at -
      http://mail-archives.apache.org/mod_mbox/pig-user/201402.mbox/%3C2014022712405096933026@gmail.com%3E

      and

      http://stackoverflow.com/questions/17533154/pig-java-lang-nosuchfieldexception-jobsinprogress-exception

      1. PIG-4139.patch
        0.7 kB
        Suhas Satish

        Activity

        Hide
        cheolsoo Cheolsoo Park added a comment -

        +1

        Show
        cheolsoo Cheolsoo Park added a comment - +1
        Hide
        cheolsoo Cheolsoo Park added a comment -

        Committed to trunk and branch 0.13.

        Show
        cheolsoo Cheolsoo Park added a comment - Committed to trunk and branch 0.13.
        Hide
        suhassatish Suhas Satish added a comment -
        Show
        suhassatish Suhas Satish added a comment - thanks Cheolsoo Park

          People

          • Assignee:
            suhassatish Suhas Satish
            Reporter:
            ssatish Suhas Satish
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development