Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7131

During HA upgrade, JournalNode should create a new committedTxnId file in the current directory

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.6.0
    • Component/s: qjm
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently while doing HA upgrade, we do not create a new committedTxnId file in the new current directory of JournalNode. And before we have the fix in HDFS-7042, since the file channel is never closed, for any new journal we're actually updating the committedTxnId file in the previous directory. This can cause NN to fail to start while rollback.

      HDFS-7042 fixes the main part of the issue: the file channel inside of the committedTxnId object gets closed thus later a new file can be created in the current directory. But maybe it is still better to copy the content file during the upgrade so that we can always use it for sanity check.

        Attachments

        1. HDFS-7131.000.patch
          10 kB
          Jing Zhao
        2. HDFS-7131.001.patch
          10 kB
          Jing Zhao

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              jingzhao Jing Zhao
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: