Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8645 Stabilize branch-1-win
  3. HADOOP-8874

HADOOP_HOME and -Dhadoop.home (from hadoop wrapper script) are not uniformly handled

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1-win
    • Fix Version/s: 1-win
    • Component/s: scripts, security
    • Labels:
    • Environment:

      Called from external process with -D flag vs HADOOP_HOME set.

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      There is a -D flag to set hadoop.home, which is specified in the hadoop wrapper scripts. This is particularly useful if you want SxS execution of two or more versions of hadoop (e.g. rolling upgrade). However, it isn't honored at all. HADOOP_HOME is used in 3-4 places to find non-java hadoop components such as schedulers, scripts, shared libraries, or with the Windows changes – binaries.

      Ideally, these should all resolve the path in a consistent manner, and callers shuold have a similar onus applied when trying to resolve an invalid path to their components. This is particularly relevant to scripts or binaries that may have security impact, as absolute path resolution is generally safer and more stable than relative path resolution.

        Attachments

        1. HADOOP-8874.1-win.003.patch
          10 kB
          Ivan Mitic
        2. HADOOP-8645.1-win.002.patch
          9 kB
          John Gordon
        3. fix_home_np.patch
          9 kB
          John Gordon

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jgordon John Gordon
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: