Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3092

Enable journal protocol based editlog streaming for standby namenode

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.23.3, 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: ha, namenode
    • Labels:
      None

      Description

      Currently standby namenode relies on reading shared editlogs to stay current with the active namenode, for namespace changes. BackupNode used streaming edits from active namenode for doing the same. This jira is to explore using journal protocol based editlog streams for the standby namenode. A daemon in standby will get the editlogs from the active and write it to local edits. To begin with, the existing standby mechanism of reading from a file, will continue to be used, instead of from shared edits, from the local edits.

        Attachments

        1. ComparisonofApproachesforHAJournals.pdf
          72 kB
          Bikas Saha
        2. JNStates.png
          48 kB
          Tsz Wo Nicholas Sze
        3. MultipleSharedJournals.pdf
          191 kB
          Tsz Wo Nicholas Sze
        4. MultipleSharedJournals.pdf
          161 kB
          Suresh Srinivas
        5. MultipleSharedJournals.pdf
          150 kB
          Suresh Srinivas
        6. Removingfilerdependency.pdf
          59 kB
          Eli Collins

          Issue Links

            Activity

              People

              • Assignee:
                sureshms Suresh Srinivas
                Reporter:
                sureshms Suresh Srinivas
              • Votes:
                0 Vote for this issue
                Watchers:
                35 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: