[HDFS-11914] Add more diagnosis info for fsimage transfer failure.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Labels: supportability
• Hadoop Flags: Reviewed
• Assignee: Yongjun Zhang
• Reporter: Yongjun Zhang
• Created: 02/Jun/17 07:24
• Updated: 02/Oct/19 17:14
• Resolved: 06/Jun/17 19:57

Description

Hit a fsimage download problem:

Client tries to download fsimage, and got:

WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:java.io.IOException: File http://x.y.z:50070/imagetransfer?getimage=1&txid=latest received length xyz is not of the advertised size abc.

Basically client does not get enough fsimage data and finished prematurely without any exception thrown, until it finds the size of data received is smaller than expected. The client then closed the conenction to NN, that caused NN to report

INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Connection closed by client

This jira is to add some more information in logs to help debugging the sitaution. Specifically, report the stack trace when the connection is closed. And how much data has been sent at that point. etc.