[HADOOP-4539] Streaming Edits to a Backup Node.

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Hadoop Flags: Incompatible change, Reviewed
• Release Note: Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.
• Assignee: Konstantin Shvachko
• Reporter: Konstantin Shvachko
• Created: 29/Oct/08 22:18
• Updated: 12/Aug/11 04:36
• Resolved: 14/Mar/09 04:29

Description

Currently Secondary name-node acts as mere checkpointer.
Secondary name-node should be transformed into a standby name-node (SNN).
The long term goal is to make it a warm standby.
The purpose of this issue is to provide real time streaming of edits to SNN so that it contained the up-to-date namespace state.

Issue Links

• incorporates: HADOOP-5511 Add Apache License to EditLogBackupOutputStream
• is blocked by: HADOOP-2337 Trash never closes FileSystem
• is related to: HDFS-1572 Checkpointer should trigger checkpoint with specified period.
• is related to: HDFS-1583 Improve backup-node sync performance by wrapping RPC parameters
• relates to: HADOOP-5119 FSEditLog should not use FSNamesystem.getFSNamesystem()
• relates to: HADOOP-5559 BackupStorage should not use FSNamesystem.getFSNamesystem()
• relates to: HBASE-2098 [EC2] Build a HA cluster
• relates to: HDFS-192 TestBackupNode sometimes fails
• relates to: HDFS-311 Modifications to enable multiple types of logging
• relates to: HADOOP-5502 Backup and checkpoint nodes should be documented