[HADOOP-1491] After successful distcp, couple of checksum error files

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.12.3
• Component/s: util
• Assignee: Dhruba Borthakur
• Reporter: Koji Noguchi
• Created: 13/Jun/07 23:10
• Updated: 25/Mar/09 20:18
• Resolved: 21/Jun/07 00:11

Description

Tried copying 700,000 files with distcp. 8 mappers per node. Single dfs.client.buffer.dir.
Distcp ran on 25 nodes mapreduce.

Couple of tasks failed, but job was successful.

When checked, 12 files were corrupted. (Checksum error)

This is repeatable.

I'll add more information as we find.

Issue Links

• is duplicated by: HADOOP-1396 FileNotFound exception on DFS block