[HDFS-732] HDFS files are ending up truncated

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.20.2
• Fix Version/s: 0.20.2
• Component/s: hdfs-client
• Hadoop Flags: Reviewed
• Assignee: Tsz-wo Sze
• Reporter: Christian Kunz
• Created: 25/Oct/09 00:54
• Updated: 31/Oct/09 00:38
• Resolved: 30/Oct/09 02:11

Description

We recently started to use hadoop-0.20.1 in our production environment (less than 2 weeks ago) and already had 3 instances of truncated files, more than we had for months using hadoop-0.18.3.
Writing is done using libhdfs, although it rather seems to be a problem on the server side.

I will post some relevant logs (they are too large to be put into the description)

Issue Links

• relates to: HADOOP-4760 HDFS streams should not throw exceptions when closed twice
• relates to: HADOOP-5859 FindBugs : fix "wait() or sleep() with locks held" warnings in hdfs