Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7131

During HA upgrade, JournalNode should create a new committedTxnId file in the current directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 2.6.0
    • qjm
    • None
    • Reviewed

    Description

      Currently while doing HA upgrade, we do not create a new committedTxnId file in the new current directory of JournalNode. And before we have the fix in HDFS-7042, since the file channel is never closed, for any new journal we're actually updating the committedTxnId file in the previous directory. This can cause NN to fail to start while rollback.

      HDFS-7042 fixes the main part of the issue: the file channel inside of the committedTxnId object gets closed thus later a new file can be created in the current directory. But maybe it is still better to copy the content file during the upgrade so that we can always use it for sanity check.

      Attachments

        1. HDFS-7131.001.patch
          10 kB
          Jing Zhao
        2. HDFS-7131.000.patch
          10 kB
          Jing Zhao

        Activity

          People

            jingzhao Jing Zhao
            jingzhao Jing Zhao
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: