[HDFS-15422] Reported IBR is partially replaced with stored info when queuing.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.3.1, 3.4.0
• Fix Version/s: 3.3.1, 3.4.0, 2.10.2, 3.2.3
• Component/s: namenode
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Stephen O'Donnell
• Reporter: Kihwal Lee
• Created: 19/Jun/20 15:06
• Updated: 04/Apr/24 19:39
• Resolved: 24/Feb/21 14:59

Description

When queueing an IBR (incremental block report) on a standby namenode, some of the reported information is being replaced with the existing stored information. This can lead to false block corruption.

We had a namenode, after transitioning to active, started reporting missing blocks with "SIZE_MISMATCH" as corrupt reason. These were blocks that were appended and the sizes were actually correct on the datanodes. Upon further investigation, it was determined that the namenode was queueing IBRs with altered information.

Although it sounds bad, I am not making it blocker

Issue Links

• relates to: HDFS-17453 IncrementalBlockReport can have race condition with Edit Log Tailer