Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10516

the NodeManager in slave does not starting

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.9
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Environment:

      two node cluster
      ubuntu 12.04 LTS in both
      Java version "1.7.0_25"
      node 1: core i5 4 GB RAM
      node 2: core i3 4 GB RAM

    • Release Note:
      Hide
      Not a hadoop bug, its a config/network setup problem at your end, as shown in the stack trace. Please practise interpreting them -its something ops teams end up doing well

      For further infomration
      https://wiki.apache.org/hadoop/InvalidJiraIssues
      https://wiki.apache.org/hadoop/TroubleShooting
      Show
      Not a hadoop bug, its a config/network setup problem at your end, as shown in the stack trace. Please practise interpreting them -its something ops teams end up doing well For further infomration https://wiki.apache.org/hadoop/InvalidJiraIssues https://wiki.apache.org/hadoop/TroubleShooting

      Description

      the Node Manager cannot start in the slave node and this is the log:
      2014-04-17 14:47:54,217 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
      org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
      at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
      at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:205)
      at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:328)
      at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:370)
      Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
      at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:139)
      at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
      ... 3 more
      Caused by: java.lang.reflect.UndeclaredThrowableException
      at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
      at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:176)
      at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:135)
      ... 4 more
      Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From fatima-HP-ProBook-4520s/127.0.1.1 to 0.0.0.0:8031 failed $
      at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:144)
      at com.sun.proxy.$Proxy24.registerNodeManager(Unknown Source)
      at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
      ... 6 more
      Caused by: java.net.ConnectException: Call From fatima-HP-ProBook-4520s/127.0.1.1 to 0.0.0.0:8031 failed on connection exception: java.net.Conn$
      at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:700)
      at org.apache.hadoop.ipc.Client.call(Client.java:1098)
      at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:141)
      ... 8 more
      Caused by: java.net.ConnectException: Connection refused
      at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
      at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
      at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
      at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
      at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:462)
      at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:559)
      at org.apache.hadoop.ipc.Client$Connection.access$2100(Client.java:207)
      at org.apache.hadoop.ipc.Client.getConnection(Client.java:1204)
      at org.apache.hadoop.ipc.Client.call(Client.java:1074)
      ... 9 more
      2014-04-17 14:47:54,221 INFO org.apache.hadoop.ipc.Server: Stopping server on 41790
      2014-04-17 14:47:54,222 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system..
      2014-04-17 14:47:54,222 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system...
      2014-04-17 14:47:54,224 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped.
      2014-04-17 14:47:54,224 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete.
      2014-04-17 14:47:54,224 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:
      /************************************************************

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sami.abobala Sami Abobala
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: