Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3674

Fix TestAccumuloPigCluster on Hadoop 2

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: internal-udfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently TestAccumuloPigCluster is disabled for Hadoop 2. We need to fix it and enable it.

        Activity

        Hide
        elserj Josh Elser added a comment -

        Working my way back around to this: it seems to be a spurious failure. I haven't been able to track down what exactly is happening that's causing this. The exception I'm getting is

        java.lang.NullPointerException
        	at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:177)
        	at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1678)
        	at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1625)
        	at org.apache.pig.PigServer.registerQuery(PigServer.java:615)
        	at org.apache.pig.PigServer.registerQuery(PigServer.java:628)
        	at org.apache.pig.backend.hadoop.accumulo.TestAccumuloPigCluster.test(TestAccumuloPigCluster.java:187)
        	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        	at java.lang.reflect.Method.invoke(Method.java:606)
        	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
        	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
        	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        
        Show
        elserj Josh Elser added a comment - Working my way back around to this: it seems to be a spurious failure. I haven't been able to track down what exactly is happening that's causing this. The exception I'm getting is java.lang.NullPointerException at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:177) at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1678) at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1625) at org.apache.pig.PigServer.registerQuery(PigServer.java:615) at org.apache.pig.PigServer.registerQuery(PigServer.java:628) at org.apache.pig.backend.hadoop.accumulo.TestAccumuloPigCluster.test(TestAccumuloPigCluster.java:187) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        Hide
        elserj Josh Elser added a comment -

        Both hadoop1 and hadoop2 fail when I try to put the timeout on the JUnit Test annotation, and both work when the timeout is not present. I'm guessing that the ScriptState ThreadLocal is getting initialized differently when JUnit is running the test with the timeout. Patch removes the test exclusion and removes the commented out timeout.

        Show
        elserj Josh Elser added a comment - Both hadoop1 and hadoop2 fail when I try to put the timeout on the JUnit Test annotation, and both work when the timeout is not present. I'm guessing that the ScriptState ThreadLocal is getting initialized differently when JUnit is running the test with the timeout. Patch removes the test exclusion and removes the commented out timeout.
        Hide
        daijy Daniel Dai added a comment -

        Verified it works. Patch committed to trunk. Thanks Josh!

        Show
        daijy Daniel Dai added a comment - Verified it works. Patch committed to trunk. Thanks Josh!

          People

          • Assignee:
            elserj Josh Elser
            Reporter:
            daijy Daniel Dai
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development