If we have oozie.service.ShareLibService.mapping.file setting pointing to a metafile, then ShareLibServe loads paths from that file.
We can mention path to a directory or path to a direct file.
When path to a directory is mentioned, the paths are populated correctly, but not when we mentioned direct path for a file.
Consider following paths:
In metafile, we have
Now, the SharelibService calculates the paths as
pig - hdfs://clustername.com:8020/sharelib/pig/pig.jar,hdfs://clustername.com:8020/sharelib/pig/some.jar
spark - /sharelib/spark/spark-assembly.jar
The spark path does not have hdfs prefixed.
Later on, when we run a spark action, it fails with
Remember, if we already mentioned hdfs prefixed paths in metafile, then it works fine.