Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6212

UnsatisfiedLinkError: org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative() happened when starting MRAppMaster

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: security
    • Labels:
      None
    • Environment:

      CentOS 64bit

      Description

      I have just started to work with Hadoop 2.

      After installing with basic configs, I always failed to run any examples. Has anyone seen this problem and please help me?

      This is the log

      2015-01-08 01:52:01,599 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1420648881673_0004_000001
      2015-01-08 01:52:01,764 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
      java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
      at org.apache.hadoop.security.Groups.<init>(Groups.java:70)
      at org.apache.hadoop.security.Groups.<init>(Groups.java:66)
      at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
      at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
      at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:299)
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1473)
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1429)
      Caused by: java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:129)
      ... 7 more
      Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
      at org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native Method)
      at org.apache.hadoop.security.JniBasedUnixGroupsMapping.<clinit>(JniBasedUnixGroupsMapping.java:49)
      at org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.<init>(JniBasedUnixGroupsMappingWithFallback.java:39)
      ... 12 more
      2015-01-08 01:52:01,767 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1

      This is my configs

      core-site.xml

      <property>
      <name>fs.defaultFS</name>
      <value>hdfs://grey5:9000</value>
      </property>

      <property>
      <name>hadoop.tmp.dir</name>
      <value>/home/maidinh/hadoop2/hadoop-data</value>
      </property>

      hdfs-site.xml

      <property>
      <name>dfs.namenode.name.dir</name>
      <value>/home/maidinh/hadoop2/nn</value>
      </property>

      <property>
      <name>dfs.datanode.data.dir</name>
      <value>/data1/maidinh/hadoop2/dn,/data2/maidinh/hadoop2/dn,/data3/maidinh/hadoop2/dn</value>
      </property>

      yarn-site.xml

      <property>
      <name>yarn.resourcemanager.hostname</name>
      <value>grey5</value>
      </property>

      <property>
      <name>yarn.nodemanager.local-dirs</name>
      <value>/data4/maidinh/hadoop2/yarn-data,/data5/maidinh/hadoop2/yarn-data,/data6/maidinh/hadoop2/yarn-data</value>
      </property>

      <property>
      <name>yarn.nodemanager.log-dirs</name>
      <value>/data4/maidinh/hadoop2/yarn-logs,/data5/maidinh/hadoop2/yarn-logs,/data6/maidinh/hadoop2/yarn-logs</value>
      </property>

      <property>
      <name>yarn.nodemanager.aux-services</name>
      <value>mapreduce_shuffle</value>
      </property>

      mapred-site.xml

      <property>
      <name>mapreduce.framework.name</name>
      <value>yarn</value>
      </property>

      <property>
      <name>mapreduce.jobhistory.address</name>
      <value>grey5:10020</value>
      </property>
      <property>
      <name>mapreduce.jobhistory.webapp.address</name>
      <value>grey5:19888</value>
      </property>

      <property>
      <name>mapreduce.jobtracker.address</name>
      <value>grey5:50030</value>
      </property>

      .bashrc
      export JAVA_HOME="/usr/java/latest/"
      export HADOOP_PREFIX="/home/maidinh/hadoop2/hadoop-2.6.0"
      export HADOOP_YARN_USER="maidinh"

      export HADOOP_HOME="$HADOOP_PREFIX"
      export HADOOP_CONF_DIR="$HADOOP_PREFIX/etc/hadoop"
      export HADOOP_PID_DIR="$HADOOP_PREFIX"
      export HADOOP_LOG_DIR="$HADOOP_PREFIX/logs"
      export HADOOP_OPTS="$HADOOP_OPTS -Djava.io.tmpdir=$HADOOP_PREFIX/tmp"

      export YARN_HOME="$HADOOP_PREFIX"
      export YARN_CONF_DIR="$HADOOP_PREFIX/etc/hadoop"
      export YARN_PID_DIR="$HADOOP_PREFIX"
      export YARN_LOG_DIR="$HADOOP_PREFIX/logs"
      export YARN_OPTS="$YARN_OPTS -Djava.io.tmpdir=$HADOOP_PREFIX/tmp"

        Attachments

          Activity

            People

            • Assignee:
              maidh91 Hoang-Mai Dinh
              Reporter:
              maidh91 Hoang-Mai Dinh
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: