Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2838

Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.16.0
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      Currently there is no way to configure Hadoop to use external JNI directories. I propose we add a new variable like HADOOP_CLASS_PATH that is added to the JAVA_LIBRARY_PATH before the process is run.

      Now the users can set environment variables using mapred.child.env. They can do the following
      X=Y : set X to Y
      X=$X:Y : Append Y to X (which should be taken from the tasktracker)

      Attachments

        1. HADOOP-2838-v2.2-branch-20-example.patch
          12 kB
          Amar Kamat
        2. HADOOP-2838-v2.2.patch
          19 kB
          Amar Kamat
        3. HADOOP-2838-v1.1.patch
          8 kB
          Amar Kamat
        4. HADOOP-2838-v1.0.patch
          8 kB
          Amar Kamat

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-5803 Allow native libraries to be placed anywhere

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-2867 Add a task's cwd to it's LD_LIBRARY_PATH

          • Major - Major loss of function.
          • Closed

          Activity

            People

              amar_kamat Amar Kamat
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: