[OOZIE-1644] Default config from config-default.xml is not propagated to actions

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: trunk
• Fix Version/s: 4.1.0
• Component/s: action
• Assignee: Mona Chitnis
• Reporter: Mona Chitnis
• Created: 17/Dec/13 01:12
• Updated: 09/Dec/14 00:45
• Resolved: 28/Jan/14 19:55

Description

Though OOZIE-1600 avoids getting one type of exception while running a workflow having action with no <configuration> tag, the problem is that the default config from config-default.xml is not propagated to actions. Action-conf is currently only getting read from action.xml.

Following error was seen with launcher job

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.MapReduceMain], main() threw exception, Output directory not set in JobConf.
org.apache.hadoop.mapred.InvalidJobConfException: Output directory not set in JobConf.
	at org.apache.hadoop.mapred.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:118)
	at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:458)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:342)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:394)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:394)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548)
	at org.apache.oozie.action.hadoop.MapReduceMain.submitJob(MapReduceMain.java:92)

The actionConf needs to be copied over with WF Job default configs.

Issue Links

• breaks: OOZIE-1711 TestLiteWorkflowAppParser fails against Hadoop 2
• breaks: OOZIE-1944 Recursive variable resolution broken when same parameter name in config-default and action conf
• links to: ReviewBoard