[OOZIE-3440] [action] Oozie Spark action replaces path symlink # to %23

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.3.1, 5.1.0
• Fix Version/s: 5.2.0
• Component/s: action

Environment

Hadoop 2.7.3
Spark 2 - 2.3.0

• Assignee: Dénes Bodó
• Reporter: Dénes Bodó
• Created: 22/Feb/19 08:01
• Updated: 09/Dec/19 08:53
• Resolved: 28/Feb/19 13:12

Description

When we provide in a hive action:

• --files /etc/spark2/conf/hive-site.xml#hive-site.xml or
• <file>/etc/spark2/conf/hive-site.xml#hive-site.xml</file> or
• <file>hdfs:///tmp/spark2/conf/hive-site.xml#hive-site.xml</file> or
• <archive>/etc/spark2/conf/hive-site.xml#hive-site.xml</archive>

we get the following error:

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, File file:/etc/spark2/conf/hive-site.xml%23hive-site.xml does not exist

The culprit seems to be https://github.com/apache/oozie/blob/master/sharelib/spark/src/main/java/org/apache/oozie/action/hadoop/SparkArgsExtractor.java#L480L489 .

Please help me confirm if this is a bug or not. Meanwhile I am creating a fix/workaround to this.