Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3962

NN should periodically check writability of 'required' journals

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.0.1-alpha, 3.0.0-alpha1
    • None
    • ha, namenode
    • None

    Description

      Currently, our HA design ensures "write fencing" by having the failover controller call a fencing script before transitioning a new node to active. However, if the fencing script is based on storage fencing (and not stonith), there is no read fencing. That is to say, the old active may continue to believe himself active for an unbounded amount of time, assuming that it does not try to write to its edit log.

      This isn't super problematic, but it would be beneficial for monitoring, etc, to have the old NN periodically check the writability of any "required" journals, and abort if they become unwritable, even if there are no writes coming into the system.

      Attachments

        1. hdfs-3962.txt
          20 kB
          Todd Lipcon

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: