[OOZIE-2110] cancel delegation token of launcher jobs that stay till child jobs finish

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: trunk
• Fix Version/s: 4.2.0
• Assignee: Ryota Egashira
• Reporter: Ryota Egashira
• Created: 12/Jan/15 23:15
• Updated: 28/Aug/15 15:23
• Resolved: 03/Feb/15 19:57

Description

set mapreduce.job.complete.cancel.delegation.tokens=true for launcher job that wait for child jobs to finish (most of actions, pig,hive,java, distcp, etc). this is currently set to false.

keep mapreduce.job.complete.cancel.delegation.tokens=false for launcher job that exits right after a child job launched (mapred action), such that it does not delete delegation token while child job still running.

this change reduce the load on Namenode in terms of the number of tokens it has to maintain.