Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
5.2.0
-
None
-
None
Description
HADOOP_CONF_DIR property is empty in Spark Action containers, even though HADOOP_CONF_DIR is configured and part of the NM env whitelist:
------------------------ Environment variables ------------------------ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin HADOOP_CONF_DIR=
This happens when HADOOP_CLIENT_CONF_DIR isn't configured. It looks like Oozie maps HADOOP_CONF_DIR to HADOOP_CLIENT_CONF_DIR regardless of if HADOOP_CONF_DIR is configured and part of the whitelist.
Attachments
Issue Links
- is caused by
-
OOZIE-3492 [spark-action] Missing HADOOP_CONF_DIR property
- Closed