Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.

      Description

      Currently Secondary name-node acts as mere checkpointer.
      Secondary name-node should be transformed into a standby name-node (SNN).
      The long term goal is to make it a warm standby.
      The purpose of this issue is to provide real time streaming of edits to SNN so that it contained the up-to-date namespace state.

      1. BackupNode.patch
        183 kB
        Konstantin Shvachko
      2. BackupNode.patch
        183 kB
        Konstantin Shvachko
      3. BackupNode.patch
        183 kB
        Konstantin Shvachko
      4. BackupNode.patch
        177 kB
        Konstantin Shvachko
      5. BackupNode.patch
        177 kB
        Konstantin Shvachko
      6. BackupNode.patch
        163 kB
        Konstantin Shvachko
      7. image001.gif
        8 kB
        Konstantin Shvachko
      8. StreamEditsToBN.pdf
        67 kB
        Konstantin Shvachko
      9. StreamEditsToSNN.htm
        31 kB
        Konstantin Shvachko

        Issue Links

          Activity

          Konstantin Shvachko created issue -
          Konstantin Shvachko made changes -
          Field Original Value New Value
          Attachment StreamEditsToSNN.htm [ 12393004 ]
          Konstantin Shvachko made changes -
          Attachment image001.gif [ 12393006 ]
          Nigel Daley made changes -
          Fix Version/s 0.20.0 [ 12313438 ]
          Konstantin Shvachko made changes -
          Link This issue is blocked by HADOOP-2337 [ HADOOP-2337 ]
          Robert Chansler made changes -
          Assignee Konstantin Shvachko [ shv ]
          dhruba borthakur made changes -
          Link This issue relates to HADOOP-5188 [ HADOOP-5188 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12400499 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12400501 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12400499 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-3347 [ HADOOP-3347 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-5119 [ HADOOP-5119 ]
          Konstantin Shvachko made changes -
          Attachment StreamEditsToBN.pdf [ 12400631 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12401792 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12401793 ]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.21.0 [ 12313563 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12402109 ]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12402164 ]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Hadoop Flags [Reviewed]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12402185 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Konstantin Shvachko made changes -
          Link This issue relates to HADOOP-5502 [ HADOOP-5502 ]
          Konstantin Shvachko made changes -
          Hadoop Flags [Reviewed] [Incompatible change, Reviewed]
          Release Note Introduced Backup node, which maintains an up-to-date state of the namespace in sync with the name-node.
          Introduced Checkpoint node, which creates checkpoints of the namespace state. This is a replacement for SecondaryNameNode.
          Konstantin Shvachko made changes -
          Link This issue incorporates HADOOP-5511 [ HADOOP-5511 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-5559 [ HADOOP-5559 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-192 [ HDFS-192 ]
          Robert Chansler made changes -
          Release Note Introduced Backup node, which maintains an up-to-date state of the namespace in sync with the name-node.
          Introduced Checkpoint node, which creates checkpoints of the namespace state. This is a replacement for SecondaryNameNode.
          Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.
          Andrew Purtell made changes -
          Link This issue relates to HBASE-2098 [ HBASE-2098 ]
          Konstantin Shvachko made changes -
          Summary Streaming Edits to a Standby Name-Node. Streaming Edits to a Backup Node.
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Liyin Liang made changes -
          Link This issue is related to HDFS-1583 [ HDFS-1583 ]
          Liyin Liang made changes -
          Link This issue is related to HDFS-1572 [ HDFS-1572 ]
          Eli Collins made changes -
          Link This issue relates to HDFS-362 [ HDFS-362 ]

            People

            • Assignee:
              Konstantin Shvachko
              Reporter:
              Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              31 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development