Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2649

The ReplicationMonitor sleep period should be configurable

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.16.0
    • None
    • None

    Description

      The HDFS Namenode computes replication work for datanodes once every 3 seconds. This should be a configurable value. On large clusters, there could be many many blocks in the neededReplication queue and computing replication work for datanodes once every 3 seconds might consume lots of CPU on namenode.

      Attachments

        1. configurableReplicationPeriod.patch
          2 kB
          Dhruba Borthakur
        2. configurableReplicationPeriod.patch
          2 kB
          Dhruba Borthakur

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-2606 Namenode unstable when replicating 500k blocks at once

          • Major - Major loss of function.
          • Closed

          Activity

            People

              dhruba Dhruba Borthakur
              dhruba Dhruba Borthakur
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: