Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8645 Stabilize branch-1-win
  3. HADOOP-8874

HADOOP_HOME and -Dhadoop.home (from hadoop wrapper script) are not uniformly handled

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1-win
    • 1-win
    • scripts, security
    • Called from external process with -D flag vs HADOOP_HOME set.

    • Reviewed

    Description

      There is a -D flag to set hadoop.home, which is specified in the hadoop wrapper scripts. This is particularly useful if you want SxS execution of two or more versions of hadoop (e.g. rolling upgrade). However, it isn't honored at all. HADOOP_HOME is used in 3-4 places to find non-java hadoop components such as schedulers, scripts, shared libraries, or with the Windows changes – binaries.

      Ideally, these should all resolve the path in a consistent manner, and callers shuold have a similar onus applied when trying to resolve an invalid path to their components. This is particularly relevant to scripts or binaries that may have security impact, as absolute path resolution is generally safer and more stable than relative path resolution.

      Attachments

        1. HADOOP-8874.1-win.003.patch
          10 kB
          Ivan Mitic
        2. HADOOP-8645.1-win.002.patch
          9 kB
          John Gordon
        3. fix_home_np.patch
          9 kB
          John Gordon

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jgordon John Gordon
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: