Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3092

Enable journal protocol based editlog streaming for standby namenode

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.23.3, 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: ha, namenode
    • Labels:
      None

      Description

      Currently standby namenode relies on reading shared editlogs to stay current with the active namenode, for namespace changes. BackupNode used streaming edits from active namenode for doing the same. This jira is to explore using journal protocol based editlog streams for the standby namenode. A daemon in standby will get the editlogs from the active and write it to local edits. To begin with, the existing standby mechanism of reading from a file, will continue to be used, instead of from shared edits, from the local edits.

      1. Removingfilerdependency.pdf
        59 kB
        Eli Collins
      2. JNStates.png
        48 kB
        Tsz Wo Nicholas Sze
      3. ComparisonofApproachesforHAJournals.pdf
        72 kB
        Bikas Saha
      4. MultipleSharedJournals.pdf
        191 kB
        Tsz Wo Nicholas Sze
      5. MultipleSharedJournals.pdf
        161 kB
        Suresh Srinivas
      6. MultipleSharedJournals.pdf
        150 kB
        Suresh Srinivas

        Issue Links

          Activity

          Allen Wittenauer made changes -
          Affects Version/s 2.0.0-alpha [ 12320353 ]
          Affects Version/s 0.24.0 [ 12317653 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Won't Fix [ 2 ]
          Eli Collins made changes -
          Attachment Removingfilerdependency.pdf [ 12526102 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment JNStates.png [ 12524775 ]
          Bikas Saha made changes -
          Attachment ComparisonofApproachesforHAJournals.pdf [ 12523531 ]
          Sanjay Radia made changes -
          Link This issue is depended upon by HDFS-3278 [ HDFS-3278 ]
          Suresh Srinivas made changes -
          Link This issue relates to HDFS-3204 [ HDFS-3204 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment MultipleSharedJournals.pdf [ 12521444 ]
          Suresh Srinivas made changes -
          Attachment MultipleSharedJournals.pdf [ 12521243 ]
          Suresh Srinivas made changes -
          Attachment MultipleSharedJournals.pdf [ 12520984 ]
          Suresh Srinivas made changes -
          Assignee Suresh Srinivas [ sureshms ]
          Suresh Srinivas made changes -
          Field Original Value New Value
          Link This issue is related to HDFS-3077 [ HDFS-3077 ]
          Suresh Srinivas created issue -

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              35 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development