Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: QuorumJournalManager (HDFS-3077)
    • Component/s: ha
    • Labels:
      None

      Description

      This fixes a bug in the HDFS-3077 branch:
      If one of the JNs goes down and comes back up, it may have a discontiguous set of logs in its storage directories. This means that a future getEditLogManifest call will return a manifest that has gaps - eg it may have txn 1-3 and 7-9 but be missing 4-6. This is OK because it's guaranteed that a quorum of JNs do have those edits elsewhere.

      This situation currently causes an exception since the RemoteEditLogManifest constructor verifies that the returned log files form a contiguous set of edits. That was true for the NameNode but no longer true for this new usage.

      1. hdfs-3725.txt
        8 kB
        Todd Lipcon

        Activity

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development