[HDFS-2123] 1073: Checkpoint interval should be based on txn count, not size

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Edit log branch (HDFS-1073)
• Fix Version/s: Edit log branch (HDFS-1073)
• Component/s: namenode
• Hadoop Flags: Incompatible change, Reviewed

Release Note

The SecondaryNameNode and CheckpointNode no longer respect the value of 'dfs.namenode.checkpoint.size' (formerly known as 'fs.checkpoint.size' in 0.20 and before). Instead, use the new configuration 'dfs.namenode.checkpoint.txns' to specify the number of transactions after which the checkpointer will trigger a new checkpoint.

• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 02/Jul/11 22:19
• Updated: 05/Jul/11 17:59
• Resolved: 04/Jul/11 22:48

Description

Currently, the administrator can configure the secondary namenode to checkpoint either every N seconds, or every N bytes worth of edit log. It would make more sense to get rid of the size-based interval and instead allow the administrator to specify checkpoints every N transactions. This also simplifies the code a little bit.