Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8268

Port conflict log for data node server is not sufficient

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.7.0, 2.8.0
    • 2.8.0, 3.0.0-alpha1
    • datanode
    • None
    • x86_64 x86_64 x86_64 GNU/Linux

    • Reviewed

    Description

      Data Node Server start up issue due to port conflict.
      The data node server port "dfs.datanode.http.address" conflict is not sufficient to identify the reason of failure.
      The exception log by the server is as below

      Actual:

      2015-04-27 16:48:53,960 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
      java.net.BindException: Address already in use
      at sun.nio.ch.Net.bind0(Native Method)
      at sun.nio.ch.Net.bind(Net.java:437)
      at sun.nio.ch.Net.bind(Net.java:429)
      at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
      at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
      at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125)
      at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:475)
      at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1021)
      at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:455)
      at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:440)
      at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:844)
      at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:194)
      at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:340)
      at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:380)
      at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
      at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
      at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
      at java.lang.Thread.run(Thread.java:745)

      The above log does not contain the information of the conflicting port.

      Expected output:

      java.net.BindException: Problem binding to [0.0.0.0:50075] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
      at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792)
      at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:721)
      at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.start(DatanodeHttpServer.java:160)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:795)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1142)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:439)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2420)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2298)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2349)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2540)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2564)
      Caused by: java.net.BindException: Address already in use
      at sun.nio.ch.Net.bind0(Native Method)
      at sun.nio.ch.Net.bind(Net.java:437)
      at sun.nio.ch.Net.bind(Net.java:429)
      at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
      at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
      at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125)
      at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:475)
      at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1021)
      at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:455)
      at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:440)
      at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:844)
      at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:194)
      at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:340)
      at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:380)
      at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
      at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
      at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
      at java.lang.Thread.run(Thread.java:745)

      Attachments

        1. HDFS-8268.patch
          3 kB
          Mohammad Shahid Khan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mohdshahidkhan Mohammad Shahid Khan
            mohdshahidkhan Mohammad Shahid Khan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Issue deployment