Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-273 Improve Block report processing and name node restarts (Master Jira)
  3. HDFS-394

NameNode shoud give the DataNodes a parameter that specifies the backoff time for initial block reports

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      HADOOP-2326 adds a random backoff for the initial block reports. This however is static config parameter.
      It would be useful to have the NN tell the DN how much to backoff (i.e. rather than a single configuration parameter for the backoff). This would allow the system to adjust automatically to cluster size - smaller clusters will startup faster than larger clusters.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sanjay.radia Sanjay Radia
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: