[FALCON-2011] Document for creating cluster entity in HA enabled cluster

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.6.1
• Component/s: client, docs
• Labels: documentation

Environment

Hortonworks 2.3.4 as source and target cluster(2 different clusters).
HA enabled for both RM and NN in both the clusters.
Trying to implement https://falcon.apache.org/HiveIntegration.html

• Flags: Important
• Assignee: Unassigned
• Reporter: Rahul Pathak
• Created: 06/Jun/16 12:21
• Updated: 09/Feb/17 21:14
• Resolved: 06/Jun/16 14:04

Description

I have tried below cluster entity definitions without any success:

For source cluster one at a time:
interface type="execute" endpoint="src-resourceManager1:8050"
interface type="execute" endpoint="src-resourceManager2:8050"
interface type="execute" endpoint="src-resourceManager1:8032"
interface type="execute" endpoint="src-resourceManager2:8032"

On target cluster one at a time:
interface type="execute" endpoint="tgt-resourceManager1:8050"
interface type="execute" endpoint="tgt-resourceManager2:8050"
interface type="execute" endpoint="tgt-resourceManager1:8032"
interface type="execute" endpoint="tgt-resourceManager2:8032"

With different combination of below on target oozie server

<name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
<value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8050=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8050=/etc/src_hadoop/conf</value> 

And

<name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
<value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8032=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8032=/etc/src_hadoop/conf</value> 

I get below oozie exception while running table-export

JA009: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses

However it has worked fine before enabling HA on both the clusters.