Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7541

Upgrade Domains in HDFS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1, 2.8.2
    • None
    • None

    Description

      Current HDFS DN rolling upgrade step requires sequential DN restart to minimize the impact on data availability and read/write operations. The side effect is longer upgrade duration for large clusters. This might be acceptable for DN JVM quick restart to update hadoop code/configuration. However, for OS upgrade that requires machine reboot, the overall upgrade duration will be too long if we continue to do sequential DN rolling restart.

      Attachments

        1. SupportforfastHDFSdatanoderollingupgrade.pdf
          125 kB
          Ming Ma
        2. UpgradeDomains_design_v2.pdf
          288 kB
          Ming Ma
        3. HDFS-7541.patch
          67 kB
          Ming Ma
        4. HDFS-7541-2.patch
          89 kB
          Ming Ma
        5. UpgradeDomains_Design_v3.pdf
          242 kB
          Ming Ma

        Issue Links

          Activity

            People

              mingma Ming Ma
              mingma Ming Ma
              Votes:
              0 Vote for this issue
              Watchers:
              42 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: