Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2634

Standby needs to ingest latest edit logs before transitioning to active`

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • HA branch (HDFS-1623)
    • HA branch (HDFS-1623)
    • ha, namenode
    • None

    Description

      When the standby transitions to active state, it needs to read the latest edit logs before it reopens them for write access. Currently, the transition calls stopStandbyServices, which stops the tailer, but doesn't read ahead to the very end. This ends up leaving the shared edits dir in an inconsistent state where we have overlapping transaction IDs.

      Attachments

        1. hdfs-2634.txt
          27 kB
          Todd Lipcon
        2. hdfs-2634.txt
          26 kB
          Todd Lipcon

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: