Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2324

A syntax error in the kill node causes the workflow to get stuck and other problems

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: trunk
    • Fix Version/s: 4.3.0
    • Component/s: None
    • Labels:
      None

      Description

      A syntax error normally causes the action to go to the "fail to" transition, which is typically a kill node, which kills the workflow. Unfortunately, in the kill action, we don't have that behavior, so if you get a syntax error in the kill node, it looks like Oozie gets stuck and might be requeueing the command to retry it. This can then clog up the callable queue, and cause other jobs to not get processed. Oozie should better handle an error in the kill node.

      In the log, we see this:

      2015-07-30 16:49:23,610  WARN SignalXCommand:523 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] Exception in SignalXCommand
      javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      2015-07-30 16:49:23,612 ERROR SignalXCommand:517 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] XException,
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              ... 22 more
      2015-07-30 16:49:23,612 ERROR ActionEndXCommand:517 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] XException,
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              ... 22 more
      2015-07-30 16:49:23,613 ERROR ActionStartXCommand:517 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] XException,
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              ... 22 more
      2015-07-30 16:49:23,614 ERROR SignalXCommand:517 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] XException,
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              ... 22 more
      2015-07-30 16:49:23,614 ERROR ActionEndXCommand:517 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] XException,
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              ... 22 more
      2015-07-30 16:49:23,615  WARN CallableQueueService$CallableWrapper:523 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] exception callable [action.end], E0729: Kill node message [fail-output]
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:352)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:434)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.command.XCommand.call(XCommand.java:356)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
              at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
              at org.apache.oozie.command.XCommand.call(XCommand.java:286)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
              at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
              at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
              at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
              at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
              ... 22 more
      

      And then a few mins later, this repeats every minutes, after the StatusTransitService runs:

      015-07-30 16:51:59,174  WARN SignalXCommand:523 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] Exception in SignalXCommand
      javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
      	at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
      	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
      	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
      	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
      	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
      	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      2015-07-30 16:51:59,176 ERROR SignalXCommand:517 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] XException,
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
      	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
      	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
      	at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
      	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
      	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
      	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
      	... 6 more
      2015-07-30 16:51:59,176  WARN CallableQueueService$CallableWrapper:523 - SERVER[rkanter-MBP.local] USER[rkanter] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000004-150730164245830-oozie-rkan-W] ACTION[0000004-150730164245830-oozie-rkan-W@fail-output] exception callable [signal], E0729: Kill node message [fail-output]
      org.apache.oozie.command.CommandException: E0729: Kill node message [fail-output]
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:315)
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:76)
      	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
      	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: javax.servlet.jsp.el.ELException: Encountered "{", expected one of ["}", ".", ">", "gt", "<", "lt", "==", "eq", "<=", "le", ">=", "ge", "!=", "ne", "[", "+", "-", "*", "/", "div", "%", "mod", "and", "&&", "or", "||", ":", "(", "?"]
      	at org.apache.commons.el.ExpressionEvaluatorImpl.parseExpressionString(ExpressionEvaluatorImpl.java:320)
      	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:250)
      	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
      	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
      	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:300)
      	... 6 more
      

      In the meantime, the Workflow is stuck in RUNNING state because it can't progress past the kill node.

        Attachments

        1. OOZIE-2324.003.patch
          14 kB
          Robert Kanter
        2. OOZIE-2324.002.patch
          14 kB
          Robert Kanter
        3. OOZIE-2324.001.patch
          10 kB
          Robert Kanter

          Activity

            People

            • Assignee:
              rkanter Robert Kanter
              Reporter:
              rkanter Robert Kanter
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: