[OOZIE-3325] Oozie running shell script times wrong, but hadoopjob running ok

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: pharrell.wang
• Created: 09/Aug/18 11:08
• Updated: 09/Aug/18 11:12

Description

**Log as follows

2018-08-08 16:38:39,461 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:38:39,466 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:38:49,461 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:38:49,466 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:38:59,451 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:38:59,457 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:39:09,466 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:39:09,471 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:39:19,467 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:39:19,472 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:39:29,468 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:39:29,473 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:39:39,456 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
2018-08-08 16:39:39,461 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
2018-08-08 16:39:49,837 WARN ActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Exception while executing check(). Error Code [ERR_UNKNOWN_ERROR], Message[ERR_UNKNOWN_ERROR: unknown error]
org.apache.oozie.action.ActionExecutorException: ERR_UNKNOWN_ERROR: unknown error
at org.apache.oozie.action.ssh.SshActionExecutor.check(SshActionExecutor.java:156)
at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:182)
at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
at org.apache.oozie.command.XCommand.call(XCommand.java:290)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:334)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:263)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:181)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.oozie.action.ActionExecutorException: unknown error
at org.apache.oozie.action.ssh.SshActionExecutor.check(SshActionExecutor.java:148)
... 10 more
2018-08-08 16:39:49,838 WARN ActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Failing Job due to failed action [ssh-abd3]
2018-08-08 16:39:49,841 WARN LiteWorkflowInstance:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Workflow Failed. Failing node [ssh-abd3]
2018-08-08 16:39:49,862 WARN CoordActionUpdateXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] E1100: Command precondition does not hold before execution, [, workflow is FAILED and coordinator action is FAILED and pending false], Error Code: E1100