[FALCON-1412] Process waits indefinitely and finally timedout even though missing dependencies are met

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7
• Fix Version/s: 0.7
• Component/s: build-tools

Environment

QA

• Assignee: Pallavi Rao
• Reporter: Pragya Mittal
• Created: 19/Aug/15 14:28
• Updated: 20/Aug/15 10:19
• Resolved: 20/Aug/15 10:04

Description

While scheduling a process it gets scheduled but instance keeps on waiting (although there are no missing dependency) and finally times out.
Process -definition is :

<?xml version="1.0" encoding="UTF-8"?><process xmlns="uri:falcon:process:0.1" name="A2e5a4c86-eb1bf7ae">
    <clusters>
        <cluster name="A2e5a4c86-19a2cd05">
            <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
        </cluster>
    </clusters>
    <parallel>1</parallel>
    <order>FIFO</order>
    <frequency>minutes(5)</frequency>
    <timezone>UTC</timezone>
    <inputs>
        <input name="inputData" feed="A2e5a4c86-a870a6f8" start="now(0,-20)" end="now(0,0)"/>
    </inputs>
    <outputs>
        <output name="outputData" feed="A2e5a4c86-fcf4ee44" instance="now(0,0)"/>
    </outputs>
    <properties>
        <property name="inputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun"/>
        <property name="outputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun/output"/>
    </properties>
    <workflow path="/tmp/falcon-regression/ProcessInstanceRerunTest/aggregator"/>
    <retry policy="periodic" delay="minutes(3)" attempts="3"/>
    <ACL owner="pragya" group="dataqa" permission="*"/>
</process>

Oozie stack trace :

2015-08-19 14:29:54,187 ERROR pool-6-thread-1 CoordActionInputCheckXCommand - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] XException, 
org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
	... 6 more
Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
	at org.apache.commons.el.Logger.logError(Logger.java:484)
	at org.apache.commons.el.Logger.logError(Logger.java:545)
	at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
	... 10 more
2015-08-19 14:29:54,194  WARN pool-6-thread-1 CallableQueueService$CallableWrapper - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] exception callable [coord_action_input], E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:

org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
	... 6 more
Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
	at org.apache.commons.el.Logger.logError(Logger.java:484)
	at org.apache.commons.el.Logger.logError(Logger.java:545)
	at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
	... 10 more

Issue Links

• links to: Review Board