Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.

      Description

      Currently Secondary name-node acts as mere checkpointer.
      Secondary name-node should be transformed into a standby name-node (SNN).
      The long term goal is to make it a warm standby.
      The purpose of this issue is to provide real time streaming of edits to SNN so that it contained the up-to-date namespace state.

      1. BackupNode.patch
        183 kB
        Konstantin Shvachko
      2. BackupNode.patch
        183 kB
        Konstantin Shvachko
      3. BackupNode.patch
        183 kB
        Konstantin Shvachko
      4. BackupNode.patch
        177 kB
        Konstantin Shvachko
      5. BackupNode.patch
        177 kB
        Konstantin Shvachko
      6. BackupNode.patch
        163 kB
        Konstantin Shvachko
      7. image001.gif
        8 kB
        Konstantin Shvachko
      8. StreamEditsToBN.pdf
        67 kB
        Konstantin Shvachko
      9. StreamEditsToSNN.htm
        31 kB
        Konstantin Shvachko

        Issue Links

          Activity

          Eli Collins made changes -
          Link This issue relates to HDFS-362 [ HDFS-362 ]
          Liyin Liang made changes -
          Link This issue is related to HDFS-1572 [ HDFS-1572 ]
          Liyin Liang made changes -
          Link This issue is related to HDFS-1583 [ HDFS-1583 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Konstantin Shvachko made changes -
          Summary Streaming Edits to a Standby Name-Node. Streaming Edits to a Backup Node.
          Andrew Purtell made changes -
          Link This issue relates to HBASE-2098 [ HBASE-2098 ]
          Robert Chansler made changes -
          Release Note Introduced Backup node, which maintains an up-to-date state of the namespace in sync with the name-node.
          Introduced Checkpoint node, which creates checkpoints of the namespace state. This is a replacement for SecondaryNameNode.
          Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-192 [ HDFS-192 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-5559 [ HADOOP-5559 ]
          Konstantin Shvachko made changes -
          Link This issue incorporates HADOOP-5511 [ HADOOP-5511 ]
          Konstantin Shvachko made changes -
          Hadoop Flags [Reviewed] [Incompatible change, Reviewed]
          Release Note Introduced Backup node, which maintains an up-to-date state of the namespace in sync with the name-node.
          Introduced Checkpoint node, which creates checkpoints of the namespace state. This is a replacement for SecondaryNameNode.
          Konstantin Shvachko made changes -
          Link This issue relates to HADOOP-5502 [ HADOOP-5502 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12402185 ]
          Suresh Srinivas made changes -
          Hadoop Flags [Reviewed]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12402164 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12402109 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.21.0 [ 12313563 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12401793 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12401792 ]
          Konstantin Shvachko made changes -
          Attachment StreamEditsToBN.pdf [ 12400631 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-5119 [ HADOOP-5119 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-3347 [ HADOOP-3347 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12400499 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12400501 ]
          Konstantin Shvachko made changes -
          Attachment BackupNode.patch [ 12400499 ]
          dhruba borthakur made changes -
          Link This issue relates to HADOOP-5188 [ HADOOP-5188 ]
          Robert Chansler made changes -
          Assignee Konstantin Shvachko [ shv ]
          Konstantin Shvachko made changes -
          Link This issue is blocked by HADOOP-2337 [ HADOOP-2337 ]
          Nigel Daley made changes -
          Fix Version/s 0.20.0 [ 12313438 ]
          Konstantin Shvachko made changes -
          Attachment image001.gif [ 12393006 ]
          Konstantin Shvachko made changes -
          Field Original Value New Value
          Attachment StreamEditsToSNN.htm [ 12393004 ]
          Konstantin Shvachko created issue -

            People

            • Assignee:
              Konstantin Shvachko
              Reporter:
              Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              31 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development