Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6250 TestBalancerWithNodeGroup.testBalancerWithRackLocality fails
  3. HDFS-6342

TestBalancerWithNodeGroup.testBalancerWithRackLocality may fail if balancer.id file is huge

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      The testBalancerWithRackLocality mehtod is to test balancer moving data blocks with rack locality consideration.

      It crates two nodes cluster. One node belongs to rack0nodeGroup0, theother node blongs to rack1nodeGroup1. In this 2 datanodes minicluster, block size is 10B and total cluster capacity is 6000B ( 3000B on each datanodes). It create 180 data blocks with replication factor 2. Then, a node datanode is created (in rack1nodeGroup2) and balancer starts to balancing the cluster.

      It expects there is only data blocks moving within rack1. After balancer is done, it assumes the data size on both racks is the same. It will break
      if balancer.id file is huge and there is inter-rack data block moving.

      Attachments

        1. HDFS-6342.patch
          1.0 kB
          Chen He

        Issue Links

          Activity

            People

              airbots Chen He
              airbots Chen He
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: