[OOZIE-1750] Add ability to switch between cluster configurations used in workflow

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: workflow
• Assignee: Unassigned
• Reporter: Bjorn Jonsson
• Created: 19/Mar/14 11:17
• Updated: 19/Mar/14 11:17

Description

Add configurations to be able to check f.e directory size on cluster C2 from a workflow on cluster C1.

=================
I have two clusters C1 and C2. I am running my job on C1 and try to check the directory size on C2.
Here is my xml:
<decision name="checkdir">
<switch>
<case to="action2">
${(fs:dirSize(outputDir) gt 1 * GB)}
</case>
<default to="fail" />
</switch>
</decision>

If outputDir is on hdfs of C1 it works fine. But if outputDir is hdfs://c2-namenode/xxx it will always return false.
==================

I would like to explore the possibility to add functionality that allows fs:dirSize to pick up the correct configurations for cluster C2