Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4458

Warn if java.library.path is used for AM or Task

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 3.0.0, 2.0.2-alpha
    • Fix Version/s: 2.0.3-alpha, 0.23.7
    • Component/s: mrv2
    • Labels:
      None

      Description

      If java.library.path is used on the command line for launching an MRAppMaster or an MR Task, it could conflict with how standard Hadoop/HDFS JNI libraries and dependencies are found. At a minimum the client should output a warning and ask the user to switch to LD_LIBRARY_PATH. It would be nice to automatically do this for them but parsing the command line is scary so just a warning is probably good enough for now.

      1. MAPREDUCE-4458v3.patch
        12 kB
        Robert Parker
      2. MAPREDUCE-4458-b23v1.patch
        12 kB
        Robert Parker

        Activity

        Robert Joseph Evans created issue -
        Robert Joseph Evans made changes -
        Field Original Value New Value
        Summary Warn in java.library.path is used Warn if java.library.path is used for AM or Task
        Ravi Prakash made changes -
        Assignee Robert Joseph Evans [ revans2 ] Ravi Prakash [ raviprak ]
        Robert Parker made changes -
        Assignee Ravi Prakash [ raviprak ] Robert Parker [ robsparker ]
        Robert Parker made changes -
        Attachment MAPREDUCE-4458.patch [ 12550362 ]
        Robert Parker made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Robert Parker made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-4458-2.patch [ 12563106 ]
        Robert Parker made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 0.23.3 [ 12320060 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-4458v3.patch [ 12565491 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-4458-b23v1.patch [ 12565570 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-4458-2.patch [ 12563106 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-4458.patch [ 12550362 ]
        Jonathan Eagles made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Fix Version/s 2.0.3-alpha [ 12323275 ]
        Fix Version/s 0.23.7 [ 12323954 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320355 ]

          People

          • Assignee:
            Robert Parker
            Reporter:
            Robert Joseph Evans
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development