Ambari
  1. Ambari
  2. AMBARI-3031

Set mapreduce.admin.user.env in mapred-site.xml

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.0
    • Fix Version/s: 1.4.0
    • Component/s: controller
    • Labels:
      None

      Description

      MR Job with Compression Codec can fail because of LD_LIBRARY_PATH missing in mapred-site.xml.

      mapred-site.xml sample
      <property>
          <name>mapreduce.admin.user.env</name>
          <value>LD_LIBRARY_PATH=/usr/lib/hadoop/lib/native:/usr/lib/hadoop/lib/native/`$JAVA_HOME/bin/java -d32 -version &amp;&gt; /dev/null;if [ $? -eq 0 ]; then echo Linux-i386-32; else echo Linux-amd64-64;fi`</value>
        </property>
      
      1. AMBARI-3031.patch
        2 kB
        Sumit Mohanty
      2. AMBARI-3031_All.patch
        6 kB
        Srimanth Gunturi
      3. AMBARI-3031_2.patch
        14 kB
        Srimanth Gunturi

        Activity

        Sumit Mohanty created issue -
        Sumit Mohanty made changes -
        Field Original Value New Value
        Description MR Job with Compression Codec can fail because of LD_LIBRARY_PATH missing in mapred-site.xml.

        {code:title=mapred-site.xml from GS Installer}
        <property>
            <name>mapreduce.admin.user.env</name>
            <value>LD_LIBRARY_PATH=/usr/lib/hadoop/lib/native:/usr/lib/hadoop/lib/native/`$JAVA_HOME/bin/java -d32 -version &amp;&gt; /dev/null;if [ $? -eq 0 ]; then echo Linux-i386-32; else echo Linux-amd64-64;fi`</value>
          </property>
        {code}

        MR Job with Compression Codec can fail because of LD_LIBRARY_PATH missing in mapred-site.xml.

        {code:title=mapred-site.xml sample}
        <property>
            <name>mapreduce.admin.user.env</name>
            <value>LD_LIBRARY_PATH=/usr/lib/hadoop/lib/native:/usr/lib/hadoop/lib/native/`$JAVA_HOME/bin/java -d32 -version &amp;&gt; /dev/null;if [ $? -eq 0 ]; then echo Linux-i386-32; else echo Linux-amd64-64;fi`</value>
          </property>
        {code}

        Hide
        Sumit Mohanty added a comment -

        Verifying the change ...

        Show
        Sumit Mohanty added a comment - Verifying the change ...
        Sumit Mohanty made changes -
        Attachment AMBARI-3031.patch [ 12600067 ]
        Sumit Mohanty made changes -
        Assignee Sumit Mohanty [ sumitmohanty ] Srimanth Gunturi [ srimanth.gunturi ]
        Srimanth Gunturi made changes -
        Attachment AMBARI-3031_All.patch [ 12600087 ]
        Srimanth Gunturi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Jaimin D Jetly added a comment -

        +1 for the patch.

        Show
        Jaimin D Jetly added a comment - +1 for the patch.
        Hide
        Srimanth Gunturi added a comment -

        Problem was that Ambari UI was putting invalid XML characters as values. When they get persisted to say yarn-site.xml, YARN trips trying to parse an invalid XML file.

        The fix is that Ambari UI now escapes all invalid XML characters as documented in http://en.wikipedia.org/wiki/List_of_XML_and_HTML_character_entity_references#Predefined_entities_in_XML.

        Users can enter either the escaped or unescaped values. Both would work fine.

        Show
        Srimanth Gunturi added a comment - Problem was that Ambari UI was putting invalid XML characters as values. When they get persisted to say yarn-site.xml, YARN trips trying to parse an invalid XML file. The fix is that Ambari UI now escapes all invalid XML characters as documented in http://en.wikipedia.org/wiki/List_of_XML_and_HTML_character_entity_references#Predefined_entities_in_XML . Users can enter either the escaped or unescaped values. Both would work fine.
        Srimanth Gunturi made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Srimanth Gunturi made changes -
        Attachment AMBARI-3031_2.patch [ 12600095 ]

          People

          • Assignee:
            Srimanth Gunturi
            Reporter:
            Sumit Mohanty
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development