Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11856

Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

    XMLWordPrintableJSON

Details

    Description

      During rolling upgrade if the DN gets restarted, then it will send special OOB_RESTART status to all streams opened for write.
      1. Local clients will wait for 30 seconds to datanode to come back.
      2. Remote clients will consider these nodes as bad nodes and continue with pipeline recoveries and write. These restarted nodes will be considered as bad, and will be excluded for lifetime of stream.

      In case of small cluster, where total nodes itself is 3, each time a remote node restarts for upgrade, it will be excluded.
      So a stream writing to 3 nodes initial, will end-up writing to only one node at the end, there are no other nodes to replace.

      Attachments

        1. HDFS-11856-01.patch
          29 kB
          Vinayakumar B
        2. HDFS-11856-02.branch-2.patch
          30 kB
          Kihwal Lee
        3. HDFS-11856-02.patch
          29 kB
          Vinayakumar B
        4. HDFS-11856-branch-2.7-02.patch
          29 kB
          Vinayakumar B
        5. HDFS-11856-branch-2.8-02.patch
          30 kB
          Vinayakumar B
        6. HDFS-11856-branch-2-02.patch
          30 kB
          Vinayakumar B

        Activity

          People

            vinayakumarb Vinayakumar B
            vinayakumarb Vinayakumar B
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: