[YARN-6444] Java options being duplicated in YARN

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.3
• Component/s: scripts, yarn

Environment

CentOS 6.5, Hadoop 2.7.3, java version "1.7.0_79"

• Assignee: Unassigned
• Reporter: Ravindra Sandaruwan Ranaweera
• Created: 05/Apr/17 09:04
• Updated: 05/Apr/17 09:09

Description

Additional Java options added to "yarn-env.sh" such as

export YARN_NODEMANAGER_OPTS="$YARN_NODEMANAGER_OPTS -Duser.country=XX"

adds the same Java option two times to YARN process. Processes are started with "service" command and environment variables of the process are checked with "sed -e 's/\x0/\n/g' /proc/<PID>/environ".

This occurs because "yarn-env.sh" is executed two times from "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh" and "/usr/lib/hadoop-yarn/bin/yarn" when starting.

This is already fixed in Hadoop3.0.0-alpha1 in Hadoop-9902 but I think it is better to correct this in Hadoop2.* too.