Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3879

yarn script has vestiges of jsvc that need to be cleaned up

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: mrv2, nodemanager
    • Labels:
      None

      Description

      If nodemanager is started under root (I know, I know). The following is displayed:

      /usr/lib/jvm/java-6-sun/bin/java -Dproc_nodemanager -Xmx1000m -jvm server -Dhadoop.log.dir=/var/log/yarn -Dyarn.log.dir=/var/log/yarn -Dhadoop.log.file=yarn-yarn-nodemanager-ahmed-laptop.log -Dyarn.log.file=yarn-yarn-nodemanager-ahmed-laptop.log -Dyarn.home.dir=/usr/lib/hadoop -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -Djava.library.path=/usr/lib/hadoop/lib/native -classpath /etc/hadoop/conf:/etc/hadoop/conf:/etc/hadoop/conf:/usr/lib/hadoop/share/hadoop/common/*::/usr/lib/hadoop/*:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/:/usr/lib/hadoop/share/hadoop/hdfs/*:/usr/lib/hadoop/share/hadoop/mapreduce/*:/share/hadoop/mapreduce/*:/usr/lib/hadoop/share/hadoop/mapreduce/*:/usr/lib/hadoop/share/hadoop/mapreduce/lib/*:/etc/hadoop/conf/nm-config/log4j.properties org.apache.hadoop.yarn.server.nodemanager.NodeManager
      Unrecognized option: -jvm
      Could not create the Java virtual machine.
      

      The culprit is this bit of code that looks suspiciously like what used to be in bin/hdfs in support of jsvc launch:

      elif [ "$COMMAND" = "nodemanager" ] ; then
        CLASSPATH=${CLASSPATH}:$YARN_CONF_DIR/nm-config/log4j.properties
        CLASS='org.apache.hadoop.yarn.server.nodemanager.NodeManager'
        if [[ $EUID -eq 0 ]]; then
          YARN_OPTS="$YARN_OPTS -jvm server $YARN_NODEMANAGER_OPTS"
        else
          YARN_OPTS="$YARN_OPTS -server $YARN_NODEMANAGER_OPTS"
        fi
      
      1. MAPREDUCE-3879.patch.txt
        0.8 kB
        Roman Shaposhnik

        Activity

        Roman Shaposhnik created issue -
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-3879.patch.txt [ 12515053 ]
        Roman Shaposhnik made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj K made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Duplicate [ 3 ]

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Roman Shaposhnik
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development