[HADOOP-8874] HADOOP_HOME and -Dhadoop.home (from hadoop wrapper script) are not uniformly handled

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1-win
• Fix Version/s: 1-win
• Component/s: scripts, security
• Labels: security

Environment

Called from external process with -D flag vs HADOOP_HOME set.

• Target Version/s: 1.0.3
• Hadoop Flags: Reviewed
• Assignee: Unassigned
• Reporter: John Gordon
• Created: 03/Oct/12 04:03
• Updated: 06/Dec/12 19:00
• Resolved: 06/Dec/12 15:27

Description

There is a -D flag to set hadoop.home, which is specified in the hadoop wrapper scripts. This is particularly useful if you want SxS execution of two or more versions of hadoop (e.g. rolling upgrade). However, it isn't honored at all. HADOOP_HOME is used in 3-4 places to find non-java hadoop components such as schedulers, scripts, shared libraries, or with the Windows changes – binaries.

Ideally, these should all resolve the path in a consistent manner, and callers shuold have a similar onus applied when trying to resolve an invalid path to their components. This is particularly relevant to scripts or binaries that may have security impact, as absolute path resolution is generally safer and more stable than relative path resolution.

Issue Links

• is part of: HADOOP-8645 Stabilize branch-1-win