Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5535 Umbrella jira for improved HDFS rolling upgrades
  3. HDFS-5999

Do not create rollback fsimage when it already exists

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: datanode, ha, hdfs-client, namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently in FSEditLogLoader#applyEditLogOp, if the op is OP_START_LOG_SEGMENT, we do an extra rollback fsimage with condition "totalEdits > 1".

      This may cause some issue when we restart a NN with new software. If there is no extra checkpoint after the rollback image, the NN may generate a new rollback image using the new software, and replace the old rollback image. Then later if we want to do rollback the NN, which uses the old software, may not be able to load the rollback image.

        Attachments

        1. HDFS-5999.000.patch
          4 kB
          Jing Zhao

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              jingzhao Jing Zhao
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: