[HADOOP-8042] When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.1, 0.24.0
• Fix Version/s: 0.23.2
• Component/s: fs

Environment

KR at Yahoo

• Assignee: Daryn Sharp
• Reporter: Kevin J. Price
• Created: 10/Jan/12 22:09
• Updated: 10/Feb/12 13:23
• Resolved: 09/Feb/12 16:49

Description

Performing an hdfs -get on a file, modifying the file, and using hdfs -put to place the file back into HDFS results in a checksum error. It seems that the problem is a .crc file being generated locally from the -get command even though the -crc option was NOT specified.

Issue Links

• is blocked by: HADOOP-7998 CheckFileSystem does not correctly honor setVerifyChecksum
• is blocked by: HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum files
• is blocked by: HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum