Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-2134

Fix testProcessInstanceKillKillNotRunning test case

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • trunk
    • trunk
    • merlin
    • None

    Description

      testProcessInstanceKillKillNotRunning failed since waiting instance got killed.

      Test Case Description:

           * Schedule process. Provide data for all instances except the last ,thus making it non-materialized (waiting). 
           * Try to -kill last 3 instances.
           * Check that only running instances were affected.
      

      Test case Failure log:
      In the log , we can see "0000882-160722063010010-oozie-oozi-C@6" is in waiting but when the kill issued for last 3 running instances[ in this case 2 running and 1 waiting] , all the 3 instances are got killed [ including the instances in waiting state] .

      2016-07-22 10:18:10,030 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Try 20 of 50 (InstanceUtil:644)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@1 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@2 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@3 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@4 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@5 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@6 status is WAITING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Request Url: http://nat-r6-anms-falcon-2-4.openstacklocal:15000/api/instance/kill/process/A73856b63-3afc1e07/?start=2010-01-02T00%3A14Z&end=2010-01-02T00%3A26Z&colo=*&user.name=hrt_qa (BaseRequest:175)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Request Method: POST (BaseRequest:176)
      2016-07-22 10:18:10,051 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Request Header: Name=Cookie Value=hadoop.auth="u=hrt_qa&p=hrt_qa@EXAMPLE.COM&t=kerberos&e=1469206397045&s=vmgc7OiuViE0So52XM+c/04XuOo=" (BaseRequest:179)
      2016-07-22 10:18:10,658 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:207)
      2016-07-22 10:18:10,658 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:209)
      2016-07-22 10:18:10,658 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
      2016-07-22 10:18:10,658 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
      2016-07-22 10:18:10,659 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ The web service response is:
      {
        "status": "SUCCEEDED",
        "message": "default/KILL\n",
        "requestId": "default/1217343444@qtp-1597328335-86 - e730514a-f313-45fe-af87-69ca2bf5e92c\n",
        "instances": [
          {
            "instance": "2010-01-02T00:25Z",
            "status": "KILLED",
            "cluster": "A73856b63-223dd32f",
            "runId": 0,
            "details": "hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/25#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/20#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/15#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/10#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/05"
          },
          {
            "instance": "2010-01-02T00:20Z",
            "status": "KILLED",
            "logFile": "http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job\u003d0000882-160722063010010-oozie-oozi-C@5",
            "cluster": "A73856b63-223dd32f",
            "startTime": "2016-07-22T10:18:07Z",
            "runId": 0,
            "details": ""
          },
          {
            "instance": "2010-01-02T00:15Z",
            "status": "KILLED",
            "logFile": "http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job\u003d0000882-160722063010010-oozie-oozi-C@4",
            "cluster": "A73856b63-223dd32f",
            "startTime": "2016-07-22T10:18:07Z",
            "runId": 0,
            "details": ""
          }
        ]
      } (InstanceUtil:94)
      2016-07-22 10:18:10,659 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ statusCode: 200 (InstanceUtil:136)
      2016-07-22 10:18:10,659 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ message: default/KILL
       (InstanceUtil:137)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ APIResult.Status: SUCCEEDED (InstanceUtil:138)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ instances: [{instance:2010-01-02T00:25Z, status:KILLED, cluster:A73856b63-223dd32f}
      , {instance:2010-01-02T00:20Z, status:KILLED, log:http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job=0000882-160722063010010-oozie-oozi-C@5, cluster:A73856b63-223dd32f}
      , {instance:2010-01-02T00:15Z, status:KILLED, log:http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job=0000882-160722063010010-oozie-oozi-C@4, cluster:A73856b63-223dd32f}
      ] (InstanceUtil:271)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ status: KILLED, instance: 2010-01-02T00:25Z (InstanceUtil:277)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ status: KILLED, instance: 2010-01-02T00:20Z (InstanceUtil:277)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ status: KILLED, instance: 2010-01-02T00:15Z (InstanceUtil:277)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Testing going to end for: org.apache.falcon.regression.ProcessInstanceKillsTest.testProcessInstanceKillKillNotRunning([]) ----- Status: FAILED (TestngListener:79)
      2016-07-22 10:18:10,661 INFO  - [pool-34-thread-1:] ~ ---------------------------------------------------------------------------------------------------- (TestngListener:83)
      2016-07-22 10:18:10,662 INFO  - [pool-34-thread-1:] ~ java.lang.AssertionError: Waiting Instances expected [1] but found [0]
      	at org.testng.Assert.fail(Assert.java:94)
      	at org.testng.Assert.failNotEquals(Assert.java:494)
      	at org.testng.Assert.assertEquals(Assert.java:123)
      	at org.testng.Assert.assertEquals(Assert.java:370)
      	at org.apache.falcon.regression.core.util.InstanceUtil.validateResponse(InstanceUtil.java:284)
      	at org.apache.falcon.regression.ProcessInstanceKillsTest.testProcessInstanceKillKillNotRunning(ProcessInstanceKillsTest.java:167)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
      	at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
      	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
      	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
      	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
      	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
       (TestngListener:116)
      

      From the doc it says,
      https://oozie.apache.org/docs/4.2.0/DG_CommandLineTool.html#Killing_a_Workflow_Coordinator_or_Bundle_Job
      Given a date range to kill instances of coord, Oozie kills all instances that are in non-terminal state.

      Killing a Coordinator Action or Multiple Actions
      
      Example:
      
      $oozie job -kill <coord_Job_id> [-action 1, 3-4, 7-40] [-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z]
      The kill option here for a range of coordinator actions kills a non-terminal (=RUNNING=, WAITING , READY , SUSPENDED ) coordinator action when coordinator job is not in FAILED or KILLED state.
      
      

      Attachments

        Activity

          People

            murali.msse Murali Ramasami
            murali.msse Murali Ramasami
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: