[HDFS-15293] Relax the condition for accepting a fsimage when receiving a checkpoint

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.3.0, 3.2.2, 2.10.1, 3.4.0
• Component/s: namenode
• Labels: multi-sbnn release-blocker
• Target Version/s: 3.3.0, 3.1.4, 3.2.2, 2.10.1
• Assignee: Chen Liang
• Reporter: Chen Liang
• Created: 21/Apr/20 18:02
• Updated: 10/Jun/21 07:44
• Resolved: 18/May/20 19:37

Description

HDFS-12979 introduced the logic that, if ANN sees consecutive fs image upload from Standby with a small delta comparing to previous fsImage. ANN would reject this image. This is to avoid overly frequent fsImage in case of when there are multiple Standby node. However this check could be too stringent.

Issue Links

• Blocked: HDFS-15562 StandbyCheckpointer will do checkpoint repeatedly while connecting observer/active namenode failed
• relates to: HDFS-15287 HDFS rollingupgrade prepare never finishes