[OOZIE-3290] Distcp action between 2 secure HA hadoop clusters failed

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.1.0
• Component/s: action
• Assignee: Unassigned
• Reporter: Rohit Pegallapati
• Created: 15/Jun/18 22:41
• Updated: 28/Jun/18 18:26

Description

oozie launcher property set from distcp action does not take effect. Hadoop version is 2.6.0 (cdh 5.13.2 which has this patch included https://issues.apache.org/jira/browse/YARN-3021?attachmentOrder=asc )

When we set the same property from global configuration, this property gets picked and we do not see the exception. However setting this property at the distcp action level is what is required for us.  

<property> 
  <name> oozie.launcher.mapreduce.job.hdfs-servers.tokenrenewal.exclude</name> 
  <value> destCluster </value> 
</property>

As a result we end up getting:

0943330-180615101217371-oozie-oozi-W@snapshot-prep	-	JA009	JA009: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1529074835014_0830 to YARN : Failed to renew token: Kind: kms-dt, Service: xxx:16000, Ident: (kms-dt owner=xxx, renewer=yarn, realUser=oozie, issueDate=1529101158245, maxDate=1531520358245, sequenceNumber=446, masterKeyId=2)	--snapshot-prep	0	-	java	-	START_MANUAL	-