[FALCON-38] Falcon's parent workflow actions (pre-processing & post-processing) should have mulitple retries

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3
• Fix Version/s: 0.4, 0.5
• Component/s: oozie, process
• Labels: failures jms oozie retries,

Environment

Oozie 3.2.X +, Falcon 0.1

• Assignee: Shaik Idris Ali
• Reporter: Shaik Idris Ali
• Created: 03/Jul/13 06:58
• Updated: 15/Jan/14 07:32
• Resolved: 14/Jan/14 16:51

Description

Oozie actions may fail for various transient and non-transient problems arising in Hadoop, Network etc.

Falcon handles user-workflow action failures by sending a JMS notification to ActiveMQ (post-processing action in parent-wf), this message is used to provide automatic retries based on various retry policies defined in Process.xml. However, post-processing action of Falcon itself might fail and workflow may remain in killed/suspended state.

Oozie provides OOTB retires that can be configured per action, we should leverage this to provide Falcon's parent workflow action reruns.