Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8825 Enhancements to Balancer
  3. HDFS-7639

Remove the limitation imposed by dfs.balancer.moverThreads

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: balancer & mover
    • Labels:
      None

      Description

      In Balancer/Mover, the number of dispatcher threads (dfs.balancer.moverThreads) limits the number of concurrent moves. Each dispatcher thread sends request to a datanode and then is blocked for waiting the response. We should remove such limitation.

        Attachments

          Activity

            People

            • Assignee:
              kanaka Kanaka Kumar Avvaru
              Reporter:
              szetszwo Tsz-wo Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated: