[OOZIE-2772] Oozie job with Hive 2 action finishes with SUCCEEDED despite beeline error

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.2.0, 4.3.0
• Component/s: action

Environment

HDP 2.4, Beeline version 1.2.1000.2.4.0.0-169

• Assignee: Unassigned
• Reporter: Christoph Körner
• Created: 13/Jan/17 10:33
• Updated: 16/Jan/17 09:14

Description

Running a simple Oozie Job with a Hive 2 action and a missing init script will cause an error in beeline. However, the Oozie job is not picking up the error and reporting status SUCCEEDED in the web UI. Interestingly the launcher MR job creates a log file in the local appcache directory; however this error log is not visible in the yarn logs neither and gets deleted with the appcache automatically.

I tested it with the following statement (the complete workflow can be found on Github: https://github.com/chaosmail/oozie-bugs/tree/master/simple-hive-init/simple-hive-init-wf - you need to remove the init script there).

Query Script:

query.hive

SELECT ADD_NUMBERS(1,2) FROM tbl LIMIT 1;

The hive error log in the local appcache directory.

 
$ more appcache/application_1480609892100_0276/container_e55_1480609892100_0276_01_000002/hive2-oozie-job_1480609892100_0276.log
Connecting to jdbc:hive2://localhost:10000/default
Connected to: Apache Hive (version 1.2.1000.2.4.0.0-169)
Driver: Hive JDBC (version 1.2.1000.2.4.0.0-169)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Running init script init.hive
 init.hive (No such file or directory)
Closing: 0: jdbc:hive2://localhost:10000/default

Oozie reports job succedded.

$ oozie job -oozie http://localhost:11000/oozie -info 0000039-170111125800146-oozie-oozi-W
Job ID : 0000039-170111125800146-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : test-wf
App Path      : /user/koernerc/apps/simple-hive-init-wf
Status        : SUCCEEDED
Run           : 0
User          : root
Group         : -
Created       : 2017-01-13 09:56 GMT
Started       : 2017-01-13 09:56 GMT
Last Modified : 2017-01-13 09:56 GMT
Ended         : 2017-01-13 09:56 GMT
CoordAction ID: -

Actions
------------------------------------------------------------------------------------------------------------------------------------
ID                                                                            Status    Ext ID                 Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@:start:                                  OK        -                      OK         -
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@test-action                              OK        job_1480609892100_0276 SUCCEEDED  -
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@end                                      OK        -                      OK         -
------------------------------------------------------------------------------------------------------------------------------------