Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3259

ContainerLocalizer should get the proper java.library.path from LinuxContainerExecutor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.23.0, 2.0.0-alpha
    • 0.23.0
    • mrv2, nodemanager
    • None

    Description

      As seen in MAPREDUCE-2915, java.library.path is not being passed when the LCE spawns a JVM for ContainerLocalizer.

      However, unlike branch-0.20-security, the task runtime in 0.23 is unaffected by this. This is because tasks' run-time environment is specified in the launch script by client. Setting LD_LIBRARY_PATH is the primary way of specifying the locations of required native library in this case. The config property, mapreduce.admin.user.env is always set in the job environment and the default value is to add the path to the hadoop native library to LD_LABRARY_PATH.

      For JVM's being launched by the hadoop system scripts, java.library.path is set.

      Attachments

        1. MAPREDUCE-3259.patch.txt
          1 kB
          Kihwal Lee
        2. mapreduce-3259.patch.txt
          2 kB
          Kihwal Lee
        3. mapreduce-3259.patch
          2 kB
          Kihwal Lee

        Activity

          People

            kihwal Kihwal Lee
            kihwal Kihwal Lee
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: