Pig
  1. Pig
  2. PIG-3674

Fix TestAccumuloPigCluster on Hadoop 2

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: internal-udfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently TestAccumuloPigCluster is disabled for Hadoop 2. We need to fix it and enable it.

        Activity

        Hide
        Josh Elser added a comment -

        Working my way back around to this: it seems to be a spurious failure. I haven't been able to track down what exactly is happening that's causing this. The exception I'm getting is

        java.lang.NullPointerException
        	at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:177)
        	at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1678)
        	at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1625)
        	at org.apache.pig.PigServer.registerQuery(PigServer.java:615)
        	at org.apache.pig.PigServer.registerQuery(PigServer.java:628)
        	at org.apache.pig.backend.hadoop.accumulo.TestAccumuloPigCluster.test(TestAccumuloPigCluster.java:187)
        	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        	at java.lang.reflect.Method.invoke(Method.java:606)
        	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
        	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
        	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        
        Show
        Josh Elser added a comment - Working my way back around to this: it seems to be a spurious failure. I haven't been able to track down what exactly is happening that's causing this. The exception I'm getting is java.lang.NullPointerException at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:177) at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1678) at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1625) at org.apache.pig.PigServer.registerQuery(PigServer.java:615) at org.apache.pig.PigServer.registerQuery(PigServer.java:628) at org.apache.pig.backend.hadoop.accumulo.TestAccumuloPigCluster.test(TestAccumuloPigCluster.java:187) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        Hide
        Josh Elser added a comment -

        Both hadoop1 and hadoop2 fail when I try to put the timeout on the JUnit Test annotation, and both work when the timeout is not present. I'm guessing that the ScriptState ThreadLocal is getting initialized differently when JUnit is running the test with the timeout. Patch removes the test exclusion and removes the commented out timeout.

        Show
        Josh Elser added a comment - Both hadoop1 and hadoop2 fail when I try to put the timeout on the JUnit Test annotation, and both work when the timeout is not present. I'm guessing that the ScriptState ThreadLocal is getting initialized differently when JUnit is running the test with the timeout. Patch removes the test exclusion and removes the commented out timeout.
        Hide
        Daniel Dai added a comment -

        Verified it works. Patch committed to trunk. Thanks Josh!

        Show
        Daniel Dai added a comment - Verified it works. Patch committed to trunk. Thanks Josh!

          People

          • Assignee:
            Josh Elser
            Reporter:
            Daniel Dai
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development