[HADOOP-1649] Performance regression with Block CRCs

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.14.0
• Assignee: Raghu Angadi
• Reporter: Raghu Angadi
• Created: 23/Jul/07 23:34
• Updated: 08/Jul/09 16:41
• Resolved: 10/Aug/07 18:20

Description

Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc).

With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster.

There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will be easier to fix.