Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-528

Add ability for safemode to wait for a minimum number of live datanodes

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0, 1.1.1
    • Component/s: scripts
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When starting up a fresh cluster programatically, users often want to wait until DFS is "writable" before continuing in a script. "dfsadmin -safemode wait" doesn't quite work for this on a completely fresh cluster, since when there are 0 blocks on the system, 100% of them are accounted for before any DNs have reported.

      This JIRA is to add a command which waits until a certain number of DNs have reported as alive to the NN.

      1. hdfs-528-v4.txt
        18 kB
        Eli Collins
      2. hdfs-528-v3.txt
        15 kB
        Todd Lipcon
      3. hdfs-528-v2.txt
        15 kB
        Todd Lipcon
      4. hdfs-528.txt
        8 kB
        Todd Lipcon
      5. hdfs-528.txt
        17 kB
        Todd Lipcon
      6. h528_20120731_b-1.patch
        9 kB
        Tsz Wo Nicholas Sze

        Activity

        Todd Lipcon created issue -
        Todd Lipcon made changes -
        Field Original Value New Value
        Attachment hdfs-528.txt [ 12415554 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.21.0 [ 12314046 ]
        Todd Lipcon made changes -
        Attachment hdfs-528-v2.txt [ 12415894 ]
        Todd Lipcon made changes -
        Summary Add dfsadmin -waitDatanodes feature to block until DNs have reported Add ability for safemode to wait for a minimum number of live datanodes
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Todd Lipcon made changes -
        Attachment hdfs-528-v3.txt [ 12416143 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Todd Lipcon made changes -
        Attachment hdfs-528.txt [ 12434623 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.22.0 [ 12314241 ]
        Affects Version/s 0.21.0 [ 12314046 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        dhruba borthakur made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Eli Collins made changes -
        Attachment hdfs-528-v4.txt [ 12459757 ]
        Eli Collins made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.22.0 [ 12314241 ]
        Resolution Fixed [ 1 ]
        Konstantin Shvachko made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment h528_20120731_b-1.patch [ 12538521 ]
        Tsz Wo Nicholas Sze made changes -
        Fix Version/s 1.2.0 [ 12321657 ]
        Matt Foley made changes -
        Fix Version/s 1.1.1 [ 12321656 ]
        Fix Version/s 1.2.0 [ 12321657 ]

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development