[HADOOP-13788] datatransfer.Receiver.processOp error

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Flags: Important
• Assignee: Unassigned
• Reporter: xluren
• Created: 03/Nov/16 06:15
• Updated: 04/Nov/16 14:33
• Resolved: 04/Nov/16 14:33

Description

the hadoop version is CDH-5.8.2-1.cdh5.8.2.p0.3.

2016-11-03 14:04:16,566 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DataNode{data=FSDataset

{dirpath='[/data/0/dfs/dn/current, /data/1/dfs/dn/current, /data/10/dfs/dn/current, /data/11/dfs/dn/current, /data/2/dfs/dn/current, /data/3/dfs/dn/current, /data/4/dfs/dn/current, /data/5/dfs/dn/current, /data/6/dfs/dn/current, /data/7/dfs/dn/current, /data/8/dfs/dn/current, /data/9/dfs/dn/current]'}

, localName='hadoop-2-10-104-1-31:50010', datanodeUuid='811b3ca1-07e1-48b2-be78-6b3a7741eeb0', xmitsInProgress=0}:Exception transfering block BP-1587434107-10.104.1.19-1477411166086:blk_1089657978_18199662 to mirror 10.104.1.27:50010: java.net.NoRouteToHostException: No route to host
2016-11-03 14:04:16,566 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: opWriteBlock BP-1587434107-10.104.1.19-1477411166086:blk_1089657978_18199662 received exception java.net.NoRouteToHostException: No route to host
2016-11-03 14:04:16,567 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: hadoop-2-10-104-1-31:50010:DataXceiver error processing WRITE_BLOCK operation src: /10.104.2.26:33310 dst: /10.104.1.31:50010
java.net.NoRouteToHostException: No route to host
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:700)
at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:169)
at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:106)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:246)
at java.lang.Thread.run(Thread.java:745)

I have try to stop the iptable service ,but it does not work