Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3034

Need to be able to evacuate a datanode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      It would be very helpful if there were some way to evacuate data from one or more nodes.

      This scenario arise fairly often when several nodes need to be powered down at nearly the same time. Currently, they can only be taken down a few at a time (n-1 nodes at a time where n is the replication factor) and then you have to wait until all files on these nodes have been replicated.

      One implementation would be to be to allow the nodes in question be put into read only mode and mark all blocks on those nodes as not counting as replicants. This should cause the namenode to copy these blocks and as soon as fsck shows no under-replicated files, the nodes will be known to be clear for power-down.

      Attachments

        Activity

          People

            Unassigned Unassigned
            tdunning@veoh.com Ted Dunning
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: