Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7541

Upgrade Domains in HDFS

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1, 2.8.2
    • None
    • None

    Description

      Current HDFS DN rolling upgrade step requires sequential DN restart to minimize the impact on data availability and read/write operations. The side effect is longer upgrade duration for large clusters. This might be acceptable for DN JVM quick restart to update hadoop code/configuration. However, for OS upgrade that requires machine reboot, the overall upgrade duration will be too long if we continue to do sequential DN rolling restart.

      Attachments

        1. SupportforfastHDFSdatanoderollingupgrade.pdf
          125 kB
          Ming Ma
        2. UpgradeDomains_design_v2.pdf
          288 kB
          Ming Ma
        3. HDFS-7541.patch
          67 kB
          Ming Ma
        4. HDFS-7541-2.patch
          89 kB
          Ming Ma
        5. UpgradeDomains_Design_v3.pdf
          242 kB
          Ming Ma

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mingma Ming Ma
            mingma Ming Ma
            Votes:
            0 Vote for this issue
            Watchers:
            42 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment