Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5138

Support HDFS upgrade in HA

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.1.1-beta
    • Fix Version/s: 2.4.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      With HA enabled, NN wo't start with "-upgrade". Since there has been a layout version change between 2.0.x and 2.1.x, starting NN in upgrade mode was necessary when deploying 2.1.x to an existing 2.0.x cluster. But the only way to get around this was to disable HA and upgrade.

      The NN and the cluster cannot be flipped back to HA until the upgrade is finalized. If HA is disabled only on NN for layout upgrade and HA is turned back on without involving DNs, things will work, but finaliizeUpgrade won't work (the NN is in HA and it cannot be in upgrade mode) and DN's upgrade snapshots won't get removed.

      We will need a different ways of doing layout upgrade and upgrade snapshot. I am marking this as a 2.1.1-beta blocker based on feedback from others. If there is a reasonable workaround that does not increase maintenance window greatly, we can lower its priority from blocker to critical.

        Attachments

        1. HDFS-5138.branch-2.001.patch
          179 kB
          Jing Zhao
        2. hdfs-5138-branch-2.txt
          185 kB
          Todd Lipcon
        3. HDFS-5138.patch
          185 kB
          Aaron T. Myers
        4. HDFS-5138.patch
          184 kB
          Aaron T. Myers
        5. HDFS-5138.patch
          192 kB
          Aaron T. Myers
        6. HDFS-5138.patch
          191 kB
          Aaron T. Myers
        7. HDFS-5138.patch
          181 kB
          Aaron T. Myers
        8. HDFS-5138.patch
          181 kB
          Aaron T. Myers
        9. HDFS-5138.patch
          177 kB
          Aaron T. Myers
        10. HDFS-5138.patch
          171 kB
          Aaron T. Myers
        11. HDFS-5138.patch
          140 kB
          Aaron T. Myers
        12. HDFS-5138.patch
          140 kB
          Aaron T. Myers
        13. HDFS-5138.patch
          138 kB
          Aaron T. Myers

          Issue Links

            Activity

              People

              • Assignee:
                atm Aaron T. Myers
                Reporter:
                kihwal Kihwal Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                26 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: