Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10720

Fix intermittent test failure of TestDataNodeErasureCodingMetrics


    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: None
    • Labels:


      The test is wrongly finding out the datanode to be corrupted from the block locations. Instead of finding out a datanode which is used in the block locations it is simply getting a datanode from the cluster, which may not be a datanode present in the block locations.

          byte[] indices = lastBlock.getBlockIndices();
          //corrupt the first block
          DataNode toCorruptDn = cluster.getDataNodes().get(indices[0]);

      For example, datanodes in the cluster.getDataNodes() array indexed like, 0->Dn1, 1->Dn2, 2->Dn3, 3->Dn4, 4->Dn5, 5->Dn6, 6->Dn7, 7->Dn8, 8->Dn9, 9->Dn10

      Assume the datanodes which are part of block location is => Dn2, Dn3, Dn4, Dn5, Dn6, Dn7, Dn8, Dn9, Dn10. Now, in the failed scenario, it is getting the corrupted datanode as cluster.getDataNodes().get(0) which will be Dn1 and corruption of this datanode will not result in ECWork and is failing the tests.

      Ideally, the test should find a datanode from the block locations and corrupt it, that will trigger ECWork.


        1. HDFS-10720-00.patch
          3 kB
          Rakesh R
        2. HDFS-10720-01.patch
          3 kB
          Rakesh R
        3. HDFS-10720-02.patch
          5 kB
          Rakesh R
        4. HDFS-10720-03.patch
          4 kB
          Rakesh R



            • Assignee:
              rakeshr Rakesh R
              rakeshr Rakesh R
            • Votes:
              0 Vote for this issue
              3 Start watching this issue


              • Created: