[SPARK-35149] I am facing this issue regularly, how to fix this issue.

• Type: Question
• Status: Resolved
• Priority: Critical
• Resolution: Invalid
• Affects Version/s: 2.2.2
• Component/s: Spark Submit
• Assignee: Unassigned
• Reporter: Eppa Rakesh
• Created: 20/Apr/21 10:19
• Updated: 23/Apr/21 11:02
• Resolved: 23/Apr/21 11:02

Description

21/04/19 21:02:11 WARN hdfs.DataStreamer: Exception for BP-823308525-10.56.47.77-1544458538172:blk_1170699623_96969312
java.io.EOFException: Unexpected EOF while trying to read response from server
at org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:448)
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213)
at org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1086)
21/04/19 21:04:01 WARN hdfs.DataStreamer: Error Recovery for BP-823308525-10.56.47.77-1544458538172:blk_1170699623_96969312 in pipeline [DatanodeInfoWithStorage[10.34.39.42:9866,DS-0ad94d03-fa3f-486b-b204-3e8d2df91f17,DISK], DatanodeInfoWithStorage[10.56.47.67:9866,DS-c28dab54-8fa0-4a49-80ec-345cc0cc52bd,DISK], DatanodeInfoWithStorage[10.56.47.55:9866,DS-79f5dd22-d0bc-4fe0-8e50-8a570779de17,DISK]]: datanode 0(DatanodeInfoWithStorage[10.56.47.36:9866,DS-0ad94d03-fa3f-486b-b204-3e8d2df91f17,DISK]) is bad.