Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-273 Improve Block report processing and name node restarts (Master Jira)
  3. HDFS-394

NameNode shoud give the DataNodes a parameter that specifies the backoff time for initial block reports

    Details

    • Type: Sub-task Sub-task
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      HADOOP-2326 adds a random backoff for the initial block reports. This however is static config parameter.
      It would be useful to have the NN tell the DN how much to backoff (i.e. rather than a single configuration parameter for the backoff). This would allow the system to adjust automatically to cluster size - smaller clusters will startup faster than larger clusters.

        Activity

        Sanjay Radia created issue -
        Sanjay Radia made changes -
        Field Original Value New Value
        Issue Type Improvement [ 4 ] Sub-task [ 7 ]
        Parent HADOOP-2448 [ 12384810 ]
        Sanjay Radia made changes -
        Fix Version/s 0.17.0 [ 12312913 ]
        Sanjay Radia made changes -
        Summary Name shoud give the Datanodes a parameter that specifies the backoff time for initial block reports NameNnode shoud give the Datanodes a parameter that specifies the backoff time for initial block reports
        Robert Chansler made changes -
        Fix Version/s 0.17.0 [ 12312913 ]
        Owen O'Malley made changes -
        Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
        Key HADOOP-2444 HDFS-394
        Component/s dfs [ 12310710 ]
        Allen Wittenauer made changes -
        Summary NameNnode shoud give the Datanodes a parameter that specifies the backoff time for initial block reports NameNode shoud give the DataNodes a parameter that specifies the backoff time for initial block reports

          People

          • Assignee:
            Unassigned
            Reporter:
            Sanjay Radia
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development