[HDFS-13875] EOFException log spam in Datanode

• Type: Bug
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: hdfs
• Flags: Patch
• Assignee: Karthik Palanisamy
• Reporter: Karthik Palanisamy
• Created: 28/Aug/18 12:43
• Updated: 01/Apr/19 20:16

Description

Ambari checks datanode liveness by simply connecting to data transfer port. But this connection will be closed after a successful TCP handshake without any data transfer. Due to which datanode encountered EOFExcetion when reading an encrypted message from the closed socket. 

This issue addressed in HDFS-9572. But not handled for encrypted data transfer(SASL message).

java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:392)
at org.apache.hadoop.hdfs.protocol.datatransfer.sasl.SaslDataTransferServer.doSaslHandshake(SaslDataTransferServer.java:361)
at org.apache.hadoop.hdfs.protocol.datatransfer.sasl.SaslDataTransferServer.getEncryptedStreams(SaslDataTransferServer.java:180)
at org.apache.hadoop.hdfs.protocol.datatransfer.sasl.SaslDataTransferServer.receive(SaslDataTransferServer.java:112)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:194)
at java.lang.Thread.run(Thread.java:745)

Issue Links

• is related to: HDFS-9572 Prevent DataNode log spam if a client connects on the data transfer port but sends no data.