Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1025

[flume-0.9.4]: alwayse encountered "Address already in use" during start more than 1 agent in one node

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Won't Fix
    • Affects Version/s: 0.9.4
    • Fix Version/s: 0.9.5
    • Component/s: Shell
    • Labels:
      None

      Description

      This problem did not exists in flume-0.9.1. The following steps works in flume-0.9.1 but not in 0.9.4.
      Steps:
      1. flume node information:
      node1 (name node, flume master)
      node2 (data node, flume node)
      node3 (data node, flume node)

      2. try to start an agent 'host1' on node3
      ./flume node no_watch host1

      There are exception:
      2012-03-09 09:58:04,603 [main] INFO mortbay.log: jetty-6.1.26
      2012-03-09 09:58:04,635 [main] INFO mortbay.log: Extract /fl
      ume/webapps/flumeagent.war to /tmp/Jetty_0_0_0_0_35862_flumeagent.war__flumeagen
      t__4cgrz3/webapp
      2012-03-09 09:58:04,917 [main] WARN mortbay.log: failed SelectChannelConnector@0
      .0.0.0:35862
      java.net.BindException: Address already in use
      at sun.nio.ch.Net.bind(Native Method)
      at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:
      149)
      at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:71)
      at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnec
      tor.java:216)
      at org.mortbay.jetty.nio.SelectChannelConnector.doStart(SelectChannelCon
      nector.java:315)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at org.mortbay.jetty.Server.doStart(Server.java:235)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at com.cloudera.util.InternalHttpServer.start(InternalHttpServer.java:18
      8)
      at com.cloudera.flume.agent.FlumeNode.start(FlumeNode.java:275)
      at com.cloudera.flume.agent.FlumeNode.setup(FlumeNode.java:504)
      at com.cloudera.flume.agent.FlumeNode.main(FlumeNode.java:665)
      2012-03-09 09:58:04,918 [main] WARN mortbay.log: failed Server@4a774a77
      java.net.BindException: Address already in use
      at sun.nio.ch.Net.bind(Native Method)
      at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:
      149)
      at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:71)
      at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnec
      tor.java:216)
      at org.mortbay.jetty.nio.SelectChannelConnector.doStart(SelectChannelCon
      nector.java:315)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at org.mortbay.jetty.Server.doStart(Server.java:235)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at com.cloudera.util.InternalHttpServer.start(InternalHttpServer.java:18
      8)
      at com.cloudera.flume.agent.FlumeNode.start(FlumeNode.java:275)
      at com.cloudera.flume.agent.FlumeNode.setup(FlumeNode.java:504)
      at com.cloudera.flume.agent.FlumeNode.main(FlumeNode.java:665)
      2012-03-09 09:58:04,918 [main] WARN util.InternalHttpServer: Caught exception du
      ring HTTP server start.
      java.net.BindException: Address already in use
      at sun.nio.ch.Net.bind(Native Method)
      at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:
      149)
      at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:71)
      at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnec
      tor.java:216)
      at org.mortbay.jetty.nio.SelectChannelConnector.doStart(SelectChannelCon
      nector.java:315)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at org.mortbay.jetty.Server.doStart(Server.java:235)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at com.cloudera.util.InternalHttpServer.start(InternalHttpServer.java:18
      8)
      at com.cloudera.flume.agent.FlumeNode.start(FlumeNode.java:275)
      at com.cloudera.flume.agent.FlumeNode.setup(FlumeNode.java:504)
      at com.cloudera.flume.agent.FlumeNode.main(FlumeNode.java:665)
      2012-03-09 09:58:04,918 [main] ERROR agent.FlumeNode: Unexpected exception/error
      thrown! Unable to start HTTP server
      com.cloudera.util.InternalHttpServer$InternalHttpServerException: Unable to star
      t HTTP server
      at com.cloudera.util.InternalHttpServer.start(InternalHttpServer.java:19
      4)
      at com.cloudera.flume.agent.FlumeNode.start(FlumeNode.java:275)
      at com.cloudera.flume.agent.FlumeNode.setup(FlumeNode.java:504)
      at com.cloudera.flume.agent.FlumeNode.main(FlumeNode.java:665)
      Caused by: java.net.BindException: Address already in use
      at sun.nio.ch.Net.bind(Native Method)
      at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:
      149)
      at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:71)
      at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnec
      tor.java:216)
      at org.mortbay.jetty.nio.SelectChannelConnector.doStart(SelectChannelCon
      nector.java:315)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at org.mortbay.jetty.Server.doStart(Server.java:235)
      at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:
      50)
      at com.cloudera.util.InternalHttpServer.start(InternalHttpServer.java:18
      8)
      ... 3 more
      2012-03-09 09:58:04,949 [Heartbeat] INFO agent.MultiMasterRPC: No active master
      RPC connection
      2012-03-09 09:58:05,041 [main] INFO agent.LogicalNodeManager: creating new logic
      al node node3
      2012-03-09 09:58:05,045 [main] WARN agent.FlumeNode: Flume is using Hadoop core
      0.20.2 which does not support Security / Authentication: org.apache.hadoop.secur
      ity.UserGroupInformation.isSecurityEnabled()
      2012-03-09 09:58:05,139 [Heartbeat] INFO agent.ThriftMasterRPC: Connected to mas
      ter at node1:35872

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              fang fang chen fang fang chen
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: